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External and Internal Stimulus Factors in 
Rorschach Performance 


James Bieri and Edward Blacker 


Harvard University 1 


It is customary to conceive of the Ror- 
schach situation as one in which the subject 
(S) may respond to a variety of stimulus ele- 
ments which are available to him in the blots. 
The ordering of the stimuli or determinants 
available to S usually centers about the form 
quality of the blot. That is, the essential shape 
of the blot may constitute the only stimulus 
factor utilized in a given response. However, 
other stimulus factors may enter into the 
determination of the response. These include 
movement, color, and shading, and each may 
modify or supplant the form determinant. It 
is possible to construe these determinants as 
falling on a continuum of external-internal 
stimulus factors. Sarason (7), for example, 
has spoken of external and internal referents 
in Rorschach performance. Thus, color is an 
aspect of the blot that is physically present 
in the blot as a stimulus. In this respect it is 
a readily available external stimulus factor. 
On the other hand, movement represents an 
internal stimulus factor having no intrinsic 
representation in the blot material. It is, so 
to speak, a stimulus quality more proximal to 
S, one which is apparently more a function of 
some internal process rather than of the ex- 
ternal stimulus. 

Thus we may assume that two categories 
of Rorschach responses exist, those responses 
whose determinants represent external quali- 
ties of the stimulus material, and those re- 
Sponses whose determinants are more a func- 
tion of S than of the physical stimulus mate- 
rial, In the former category would be placed 
the form, color, and shading responses, while 


L Pak study was facilitated by a grant from the 
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in the latter would be found the various types 
of movement responses. It would seem ap- 
propriate, therefore, to analyze and establish 
behavioral correlates of these two classes of 
conceptual responses. If these two classes of 
responses do indeed have different behavioral 
correlates, then their utilization in a broader 
clinical and personality framework would seem 
warranted. 

In the present study, the chief emphasis 
will be on the two representatives of these re- 
sponse categories discussed above which are 
utilized in Rorschach’s experience-type, i.e., 
human movement and color responses. Start- 
ing with Rorschach himself (6), the experi- 
ence-type has been a fundamental variable in 
Rorschach interpretation. Both human move- 
ment and color responses hold key positions 
because of their frequency of occurrence and 
of their assumed clinical significance. In ad- 
dition, there is an increasing body of research 
literature relevant to the personality and be- 
havioral characteristics associated with these 
two types of responses. Secondarily, this study 
will be concerned with two other kinds of re- 
sponses on the external-internal stimulus con- 
tinuum, i.e., shading and nonhuman move- 
ment responses, respectively. The behavioral 
characteristic which will be primarily em- 
ployed in investigating these two classes of 
responses will be that of reaction time. 

Investigating these two classes of responses 
by means of reaction time behavior can be 
understood when we consider the nature of 
the response categories discussed above. Color 
is an immediately available external stimulus, 
which may be utilized in giving a response. 
Movement, however, has in addition an inter- 
mediate level of response. The S perceives the 
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form quality of the blot. apparently rejects or 
ignores other external stimulus factors which 
may be present. and irvokes instead an in- 
ternal modification of the stimulus such that 
movement is perceived in the blot. The inter- 
vention of this intermediate, more subjective 
process implies that, other things being equal, 
the time required for the movement response 
may be greater than that for the color re- 
sponse. Schematically, we may represent this 
state of affairs as follows: 


a Color 
Stimulus (63 Response 
Sh 
> Internal Movement 
F} © Stimulus ~~ Response 
Stimulus Cc 
Sh 


Several recent studies have investigated 
this relationship originally discussed by Ror- 
schach, that is, that movement or kinesthetic 
responses represent an absence or delay of 
acting-out, overt motor behavior, while color 
Tesponses imply a greater tendency to im- 
mediate action. Siipola and Taylor (10), us- 
ing achromatic blots, found a gr 
tion of M responses under “ 
than under “pressure” condit 
sults were obtained by Singe 
Goldman (11). In their stud 
forced to delay or inhibit re 
responses were produced. Other studies in this 
area have also obtained res 
positive relationship betwe 
and inhibited motor behavi 
studies (5, 8, 10, Lt, 2 
marily concerned with m 
rather than color responses. Thus, while the 
M:Sum C ratio implies a comparison of two 
response variables in predicting behavior, re- 
search has dealt chiefly with single variables, 
notably that of human movement. In the 
Present study, primary emphasis is placed 
upon the comparison of experience-type pat- 
terns (introversive, extratensive, and ambi- 
equal) rather than upon the individual com- 
ponents of the experience-type. 

With these considerations in mind, the fol- 
lowing problems were posed for investigation: 

1. Utilizing reaction time as a behavioral 
criterion, are there differences in the behavior 


eater produc- 
free” conditions 
ions. Similar re- 
r, Meltzoff, and 
y, when Ss were 
sponses, more M 


or (5, 12). These 
) have been pri- 
ovement responses 


of Ss depending upon the kind of experience 
balance produced? 

2. If there is a difference in the behavior of 
Ss with different experience types, is this dif- 
ference specific to responses of a certain type, 
or is it general to all responses to the blots? 

3. If behavioral differences are found in 
Problem 1 between Ss who emphasize re- 
sponses with internal and external stimulus 
factors, will the same sort of behavioral dif- 
ferences exist between Ss in relation to other 
Rorschach responses belonging to these two 
categories? 


Method 


Owing to the nature of the study, it was 
necessary to modify the Rorschach procedure 
so that a reaction time could be obtained for 
each response and to insure that each S re- 
acted to the identical blot material. To meet 
these demands, only a portion (a Rorschach 
D) of each of the standard blots was used. 
The portions of the blots utilized were se- 
lected according to the ease with which any 
given blot area could be given variable fits 
pretations in terms of determinants and ‘ae? 
tent. Thus, each blot area selected was judged 
capable of eliciting at least two of the a 
major determinants, i.e., form, color, aione) 
and movement. In addition, the number o 
achromatic and chromatic blots was in the 
same proportion as in the regular series See 
achromatic, five chromatic blots). The blo 
areas chosen, in order of the administration: 
are listed below with Beck's number nota- 
tion (1). 


Card I: entire center “figure” area (D 4) 

Card II: upper left red (D 2) 

Card IV: lower center area (D 1) 

Card III: upper left red inverted (D 2) ” 

Card V: entire right half without “antenna 
(D 4) og SE 

Card VIII: bottom center pink and orange area 
verted (D 2) ji 

Card VI: entire left half of card without top pr 
jection, card rotated 90 degrees to righ 
(D 4) 5 

Card IX: left green figure, card rotated 90 degree 
to right (D 1) 

Card VII: entire right half of card (D 9) 

Card X: 


: upper left blue area (D 1) 


Each blot was prepared by making a ae 
plate the same size as a Rorschach card 0 
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white posterboard in which a slot was cut 
large enough to expose the desired blot por- 
tion. Each template was taped to its respec- 
tive card with the appropriate blot portion 
exposed. Thus, each blot area was exposed on 
a card the same size as the original Rorschach 
cards. 


Administration 


Each S was given the modified Rorschach 
individually by either of the two authors. The 
S was told that he was going to be shown a 
series of inkblots. He was instructed to look 
at the entire blot and to tell the examiner 
(E) what it looked like or what it could be. 
The S was again reminded to look at the 
whole blot. Following this, the first card was 
presented to S. A stop watch was held un- 
obtrusively by Æ, and the reaction time to 
each response was noted. As soon as S gave 
his initial response to the card, the card was 
removed and replaced with the next card in 
the series. The Æ handed each card to S in 
the position in which it was to be viewed. If 
S started to turn the card, Æ asked him to 
keep it in the original position. Attempts to 
turn the cards were surprisingly few, and by 
having S hold each card it was possible to 
approximate more closely actual Rorschach 
testing conditions. 

After S had given responses to the ten blots, 
he was then told that he would look at the 
blots again, and this time he was to tell E 
what else he saw, what else it might look like. 
Following this second series of the cards, the 
identical procedure was repeated once more. 
On each response of each of the three series 
the reaction time and content were recorded 
by Æ, At the end of the third series, an in- 
quiry was conducted card by card in the usual 
manner. Thus, a total of thirty responses was 
obtained for each S, three associations having 
been given to each of the ten blots. 

Owing to the nature of the modified Ror- 
schach used, some of the Ss repeated a re- 
Sponse which they had given previously to 
the same blot. In these cases S would usu- 
ally say, “I can’t see anything different from 
last time,” or “It still looks like a to 
me.” Under these circumstances, Æ would re- 
Cord the reaction time when the statement 


was made, and the response would be scored 
as originally given. 
o 


Subjects 


A total of 40 paid male undergraduate Ss, 
primarily sophomores, was used in this study. 


Scoring 


All the Rorschach protocols were scored by 
one Æ, and ten of the protocols were selected 
at random and scored by the other E. Two 
measures of reliability were used. First, the 
percentage of agreement of scoring for each 
protocol was obtained. The average percent- 
age of agreement obtained for the ten records 
was 83. In addition, the number of responses 
in each determinant category was counted, 
and the scores for the two scorers were cor- 
related using the rank-order coefficient. These 
categories included 1/, FM, m, F, FC, CF, 
and Sh. The Sh category included all shading 
responses of the Klopfer type as well as the 
use of achromatic color (K, KF, FK, Fc, cF, 
c, FC’, C'F, and C’). The Sh category is simi- 
lar to that originally proposed by Hertz (4), 
except that in the present study the shading 
responses were not weighted but merely added 
to form a total S% score. The average inter- 
rater reliability for these several scoring cate- 
gories was .85. 


Results 


On the basis of the Rorschach scores, each 
S was assigned to one of three experience- 
type groups. The introversive (M > Sum C) 
group consisted of the Ss who showed a pre- 
dominance of M over Sum C. This ratio was 
computed in the usual fashion with increas- 
ing weights of !», 1 and 11% being given to 
FC, CF, and C responses, respectively. In or- 
der to be placed into the M > Sum C group, 
S had to have an M score that was at least 
two higher than his Sum C score. A total of 
17 Ss met this criterion and were placed in 
the J > Sum C group. Similarly, 11 Ss were 
placed in the extratensive (Sum C >M) 
group because their Sum C scores were at 
least two higher than their 4 scores. The re- 
maining 12 Ss were placed in the ambiequal 
group inasmuch as their M and Sum C scores 
differed by less than two from each other. 


Table 1 


Mean Rorschach Scores for M >Sum C Group (V=17), 
Sum C>M Group (V=11) and Ambiequal 
Group (V=12), and for All Subjects 
Combined (.V=40) 


M> Sum C> Ambi- 
Score Sum C M equal Total 
M 7.9* 1.6 3.0 47 
FM 2.8 24 2.2 25 
m 1.1 1.5 0.8 1.2 
F 12.5 12.8 13" 14.0 
Sh 2.8 4.6 2.8 33 
FC 1.5 2.1 1.5 1.6 
CF 1.1 5:1* 24 2.6 
Sum C 1.8 6.1* 3.3 35 


* Higher than mean 
variable at .01 level of s 


ies of other two groups on this 
nificance (two tails). 


The mean scores for all Ss combined and for 
each group are presented in Table 1. The ratio 
of the mean M and mean Sum C scores for 
the M > Sum C group was 7.9:1.8, for the 
Sum C > M group 1.6:6.1, and for the ambi- 
equal group 3.0:3.3. The differences between 
the means of the M and Sum C scores for 
both the M > Sum C group and the Sum C 
> M group are significant below the .01 level. 
On the other hand, the difference between the 
means of the M and Sum C scores for the 
ambiequal group is not significant. All tests 
of significance between means in this study 
were made by the use of White's ranking 
Procedure (3), 

Table 2 presents the mean reaction time 
scores in seconds for each of the three groups. 
It will be noted from Table 2 that the mean 
reaction times for the M > Sum C group for 
Series 2 and 3, as well as for the total reac- 
tion times, were significantly higher ($ = .05) 
than the corresponding mean reaction times 


Table 2 


Mean Reaction Time in Seconds for M> Sum (en 
Sum C>M, and Ambiequal Groups 


Series M>Sum C 


Sum C>M Ambiequal 
Series 1 17.4 10.0 12.3 
Series 2 29.7* 12.4 19.3 
Series 3 35.4* 18.2 18.1 
Total 27.4* 13.6 16.6 


* Higher tnan corresponding values in Sum C > M 
at the .05 level of significance (two tala, AS 


James Bieri and Edward Blacker 


of the Sum C >M group. While the ambi- 
equal group has reaction times generally in- 
termediate between those of the M > Sum C 
group and the Sum C > M group, these mean 
reaction times of the ambiequal group were 
not significantly different from the mean re- 
action times of the other two groups. 

Thus, in terms of Problem 1 of the study, 
we may say that groups of Ss who differ in 
terms of experience balance also tend to differ 
in terms of their reaction time behavior. These 
differences are generally significant between 
the M > Sum C and Sum C > M groups, the 
latter having shorter reaction times than the 
former. The ambiequal group tends to have 
reaction times intermediate between the pre- 
dominantly movement and color producing 
groups. 

Next we turn to Problem 2 in order to de- 
termine whether these differences are general 
to the Ss’ behavior on the Rorschach or 
whether specific kinds of responses were ac- 
countable for the differences in reaction time 
behavior. Specifically, we will compare the 
mean reaction time of each S's J/ responses 
with his mean reaction time on his CF see 
sponses, the latter being selected because more 
CF responses were given by Ss than any other 
type of color responses. For the 33 Ss who 
gave both M and CF responses, only 16 had 
greater mean reaction times to M Responses 
than to CF responses. Furthermore, if we 
consider the M > Sum C and Sum C >M 
groups separately, we find significant positive 
rank-order correlations between mean neac: 
tion time on M responses and mean reaction 
times on CF responses (rho = .71 and 62, 
respectively). These findings indicate that SS 
reaction time behavior in this situation ÍS 4 
general phenomenon, and that MM responses 
individually do not elicit longer reaction times 
than do individual CF responses. These find- 
ings are in agreement with other researches 
(10, 11) which demonstrate that the over-all 
Tesponse set to the Rorschach situation is re- 
lated to types of responses elicited. 

It should be noted that as Ss proceeded 
from one series to the next, the conceptual 
problem of giving a response became progres- 
sively more difficult. This is reflected in the 
general increase in mean reaction times from 
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series to series (Table 2). Thus, the differ- 
ence between mean reaction time on series 1 
and series 3 is significant at the .01 level for 
the M > Sum C group, at the .05 level for 
the Sum C > M group, but not significant for 
the ambiequal group. Because Ss would at 
times repeat responses due to this increased 
difficulty, it is important to rule out the pos- 
sibility that repetitions per se may have con- 
tributed to the differences found in reaction 
times between groups. That this is not the 
case is seen in the fact that there are no sta- 
tistically significant differences between the 
mean number of repetitions among the M > 
Sum C, Sum C > M and ambiequal groups. 
These mean values are 3.8, 2.7, and 6.3, re- 
spectively. In addition, the Pearson product- 
moment coefficient for all forty Ss between 
mean reaction time and number of repetitions 
is only .13. 

The third question raised was whether the 
differences in reaction time behavior obtained 
in Problem 1 also obtain in regard to other 
determinants in the same categories as the M 
and C responses. Therefore, we should ask 
whether the differences in reaction time be- 
havior which hold for AZ and C responses also 
hold for the other movement responses and 
for the shading responses we designate as Si. 
Because of the relatively low frequency of 
both FA and m responses (Table 1), these 
two types of responses were combined into 
one group, namely (FM + m). 

Since (FM + m) responses belong to the 
internal stimulus factor group, we should ex- 
pect that (FM + m) responses would be posi- 
tively correlated with M responses and reac- 
tion time, and negatively correlated with color 
responses and shading responses. Conversely, 
we expect S% responses, since they belong to 
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the external stimulus factor group, to be posi- 
tively correlated with colér responses and 
negatively correlated with M and (FM + m) 
responses and with reaction time. To analyze 
these relationships, product-moment correla- 
tions were computed between these variables 
for all forty Ss. These results are presented 
in Table 3. 

Three of the six variables in Table 3 had 
scores which were transformed by means of 
the logarithmic transformation in order to 
normalize their distributions. These were M, 
Sum C, and mean reaction time. The other 
variables had distributions which were rela- 
tively normal when original measures were 
utilized. 

From Table 3 we see that our expectations 
regarding the (FM +m) and Sk variables 
are partially borne out by the correlations ob- 
tained. (FM + m) correlates .17 with M, .14 
with mean reaction time, and — .05 with Sum 
C. None of these correlations is significantly 
different from zero, and these results may be 
attributed to chance alone. As for the S% 
variable, we find it correlates .27 with Sum C, 
— .23 with M, —.50 with mean reaction 
time, and — .37 with (FM + m). The latter 
two coefficients are significant at the .01 and 
.05 levels respectively. The significant nega- 
tive correlation between (FM +m) and Sh 
suggests that we are indeed dealing with two 
opposite response tendencies relative to these 
two variables. Thus, Ss who give more of one 
will tend to give less of the other. It will be 
noted from Table 3 that the Sh variable is 
more negatively correlated with mean reaction 
time than is the Sum C variable. This sug- 
gests that the 1/:Sh ratio would be at least 
as efficient a predictor of reaction time as the 
M:Sum C ratio. Indeed, if we substitute each 


Table 3 
Intercorrelations of Rorschach Scores and Mean Reaction Time for All Subjects (V = 40) 
— 
Score M Sum C F (EM + m) Sh 
— pr: 2 
M —.42** —.47** AZ —.23 
Suin E —25 —.05 2 
F —.35* —.38* 
pa 7* 
(FM + m) 37 
Sh 


* 05 Je Pisa p 
eg? Vel of significance (two tails). 
“Ol level of significance (two tails). 
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S's Sh score for his Sum C score in calculat- 
ing his experience-type, we find that 13 of the 
17 Ss in the M > Sum C group and eight of 
the 11 in the Sum C > M group still meet the 
experience-type criterion for their respective 
groups (x* corrected for continuity, p = .03). 
Grouping Ss according to the M:Sh ratio in 
an analogous fashion to the M:Sum C group- 
ings. we find twenty Ss in the M > Sh group, 
12 in the Sk > M group, and eight in the 
ambiequal group. The mean total reaction 
times for these groups are 27.8, 11.4, and 
15.4, respectively. Comparison of these values 
with the corresponding M:Sum C values in 
Table 2 shows the very close similarity be- 
tween the mean total reaction times. Again. 
there is a significant difference (p = .01) be- 
tween the mean total reaction time scores of 
the M > Sh and the Sh > M groups. 


Discussion 


The results of this study are congruent with 
other studies discussed earlier in indicating 
that the time dimension is an important vari- 
able involved in the production of Rorschach 
responses. This seems to be the case par- 
ticularly for JJ and Sh responses. Although 
shorter reaction times are produced by the 
Sum C> M group, reference to Table 3 in- 
dicates that the negative correlation between 
Sum C and mean reaction time is not signifi- 
cant, whereas the positive correlation between 
M and mean reaction time is significant. Thus, 
the presence or absence of M responses may 
be more crucial to reaction time behavior than 
the presence or absence of color responses. 
However, the significant negative relationship 
between Sk and reaction time supports the 
contention that short reaction time is asso- 
ciated with the fuller utilization of external 
stimulus factors in the blots whether these 
factors be color or shading. It may be that 
the side effects of color in the blots, as sug- 
gested in Siipola’s work on hue-form incon- 
gruency (9), and as observed clinically in so- 
called “color shock,” served to decrease the 
negative relationship between latency and the 
use of color. 

It should be pointed out that other studies 
have found some indications of an inverse 
relationship between movement and shading 


responses. Cox and Sarason (2) report that 
while high anxiety Ss gave more M, FM, and 
m, low anxiety Ss gave more Fc, cF, and ¢ 
responses. Similarly, Singer. Meltzoff, and 
Goldman (11) found a decrement in shading 
responses with inhibited Ss who produced 
more JM responses. We see these findings as 
consistent with our thesis that different con- 
ceptual processes are involved when internal 
and external stimulus factors are utilized in 
inkblot reactions. ; 

The ambiequal group provides several im- 
portant additions to the findings. From T able 
1, it will be observed that this was essentially 
a form response group, i.e., it produced sig- 
nificantly more F responses than the other 
two groups. Further. Table 2 indicates that 
the reaction times of this group more nearly 
approximated those of the Sum C > M group 
than of the M > Sum C group. Since we 
originally assumed form was an external 
stimulus factor, these findings would again be 
consistent with our underlying assumptions. 
However, several findings suggest that F re- 
sponses may be on a different continuum 
than the external-internal stimulus factor con 
tinuum. Thus, if form is construed as an ex- 
ternal stimulus factor. we should expect it to 
correlate negatively with mean reaction time- 
The findings in Table 3 show this correlation 
to be only — .04. In addition, if form is a 
external stimulus factor, we should expect vi 
would correlate more negatively with M and 
(FM + m) than with Sum C and Sh. How- 
ever, we find in Table 3 that F aoma 
about equally with Sh (r = — .38) and W ” 
(FM +m) (r= — 35). Thus. form T 
represent a separate stimulus factor ne 
can be combined with Rorschach determina? 
on the external-internal continuum. seit 

Intelligence appears to have played li 
tole in producing the results of this study- 
There were no significant differences betwee” 
the three groups on the vocabulary subscale 
of the Wechsler-Bellevue. None of the Ror- 
schach variables studied correlated signifi- 
cantly with intelligence as measured ÞY 
vocabulary. In addition, this intelligence 
measure correlated only .16 with mean re 
action time. 

The approach presented in this paper haf 
emphasized the formal, conceptual propertie? 


Ae 
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of inkblot reactions rather than the clinical 
or personality correlates of such reactions. It 
is our belief that both these approaches are 
of value in helping to formulate general prin- 
ciples of behavior from which predictions use- 
ful to the clinician can be made. With more 
understanding of the conceptual processes in- 
volved in reactions to blots, and of the be- 
haviors associated with these processes, we 
can proceed to develop a theoretical frame- 
work for Rorschach behavior which is both 
experimentally verifiable and clinically useful. 


Summary 

The assumption is made that all Rorschach 
responses can be conceptualized into two cate- 
gories, i.e., those responses whose determinants 
include only external stimulus factors (form, 
color, and shading) and those responses whose 
determinants include internal stimulus factors 
(movement). The primary purpose of the 
study was to determine if there was a differ- 
ence in the behavior of Ss who showed a 
predominance of one or the other of these 
two response modes. Due to the conceptual 
differences implied by these two types of re- 
sponses, it was decided that reaction time be- 
havior might provide a critical behavioral 
differentiation. In order to insure that each S 
had the opportunity to give as many different 
kinds of responses as possible, and in order 
to obtain reaction times for each response, 
a modification of the Rorschach was used. 
This modification consisted of ten selected 
details, one from each blot, which were shown 
to S in three consecutive series, always in the 
same order. Consequently, thirty responses 
were obtained from each of the forty Ss. 
Each § was placed in one of three groups 
depending upon whether his experience-type 
was introversive (MW > Sum C), extratensive 
(Sum C > M), or ambiequal. The main find- 
ings were: 

1. The Ss in the M > Sum C group gener- 
ally had significantly longer reaction times to 
the blots than did Ss in the Sum C >M 
group. 

2. This difference was general to the Ss’ 
Performance and was not a specific effect of 
Onger reaction times in giving movement re- 
SPonses or shorter reaction times in giving 
Color responses. 


3. Other responses in the internal and ex- 
ternal stimulus factor categories were found 
to differentiate reaction time behavior in 
an analogous fashion. Thus. (FM + m) re- 
sponses correlated positively but insignifi- 
cantly with reaction time. Shading responses 
(Sh) correlated significantly in a negative di- 
rection with reaction time. Both (FM + m) 
and Sh responses correlated in the same di- 
rection with other Rorschach variables as did 
the JZ and Sum C responses. The M:S% ratio 
proved to differentiate Ss’ total reaction time 
behavior as well as the M :Sum C ratio. These 
findings suggest. in conclusion, that the cate- 
gorization of Rorschach determinants into in- 
ternal and external stimulus factors is of value 
in understanding the underlying conceptual 
processes involved in inkblot reactions. 


Received June 14, 1955. 
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Evaluation of Assumptions Underlying Interpretation 
of Sentence Completion Tests 


David K. Trites 
School of Aviation Medicine, USAF, Randolph Field, Texas 


The present study was undertaken to evalu- 
ate two of the assumptions sometimes made 
in clinical, but more frequently in psychomet- 
tic, or objective, use of projective-type sen- 
tence completion tests. (a) Incomplete sen- 
tence stimulus items whose verbal content and 
meaning are immediately apparent and gen- 
erally agreed upon will elicit responses which 
refer to this generally agreed upon meaning. 
(b) Systems of response classification which 
represent the attitudes and objects referred 
to by both stimulus and response may be de- 
veloped by considering only the verbal con- 
tent of the stimuli. 

The evaluation of these assumptions was 
based upon a factor analysis of the tetra- 
choric intercorrelations of 74 of the items 
from an 88 item sentence completion test 
which had been administered as part of an 
experimental battery of adaptability screen- 
ing tests to aviation cadets and student offi- 
cers as they entered flight training. For the 
correlations, the responses of 392 cadets were 
classified dichotomously as indicating either 
a positive or negative attitude with reference 
to adjustment to the pilot training program. 
Independently, responses were classified into 
one of 13 scoring categories covering what 
seemed to be the psychologically relevant 


areas with respect to both stimulus items and 
adaptability criteria. 


1 An extended report of this study was published 
as Psychiatric screening of flying personnel: Evalua- 
tion of assumptions underlying interpretation of sen- 
tence completion tests, by David K. Trites. Air Uni- 
versity, USAF School of Aviation Medicine, No. 55- 
33. Randolph Field, Texas, March, 1955. It may be 
obtained without charge from David K. Trites, 


School of Aviation Medicine, USAF, Randolph Field, 
Texas. 


Application of the complete centroid method 
of factoring yielded four factors. Blind rota- 
tion produced a relatively well-defined simple 
structure. . 

Factor I, called the Selj-Centered Anxiety 
Factor, was defined by items containing a 
negative statement and items referring to 
bodily characteristics. Apparently the factor 
reflects a dimension not explicitly recognized 
when the scoring key was formulated. ‘ 

Factor II, named the Air Force Motiva- 
tion Factor, had highest loadings on items 
eliciting responses referring to Air Force ac- 
tivities. and corresponded to one of the cate- 
gories of the scoring key. 

Factor III, the Jnterpersonal Factor, was 
best defined by items representing an orienta- 
tion toward interpersonal objects and aes 
ures. The factor seemed to be a complex O 
two of the scoring categories representing 1P- 
terpersonal activities. ns 

Factor IV, called the Narcissistic (oF ec 
Enhancement) Factor, had its highest nae 
ings on items referring to parents, child e A 
and most of the remaining items ad B 
personal pronoun which were not loa at 
Factor I. Some elements of one of the ae 
complex scoring categories were described PY 
this factor. 

The extraction and interpretation of these 
four factors support the first assumption ty 
defining a communality of interpretation O 
the item stimuli. The overlap of the four fac- 
tors with the categories of the scoring key i 
partial support for the second assumption. 


Brief Report. 
Received October 25, 1955. 
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The Influence of Color on Reactions to 
Incomplete Figures 


Jacob Berg* and C. J. Polyot 


University of Maine 


Throughout the history of the Rorschach 
test, no problem has received more attention 
than the clinically observed disturbances 
which some subjects display when viewing the 
chromatic inkblots (2, 3, 7). One of the more 
significant experimental efforts which deals 
with the influence of color on reactions to ink- 
blots is by Siipola (9) in which she disputed 
Rorschach’s assumption that color per se 
endowed an inkblot with “magic, affect- 
arousing properties.” Siipola postulated that 
affective phenomena such as associative block- 
ing, strong emotional reactions, and symptoms 
of conceptual and behavioral disorganization 
which occurred in some Ss when viewing a 
chromatic inkblot were probably due to the 
conceptual difficulty arising from “hue-form 
incongruity.” 

This difficulty is said to occur when the 
form of the configuration suggests a concept 
to which the color is not appropriate. Pri- 
marily, this incongruity creates a delay in 
response as indicated by the increased reac- 
tion time in responding to the chromatic blots 
as compared to an identical but achromatic 
set. At times, this incongruity also leads to 
significant changes in the content of responses. 
Since Siipola’s study has had considerable in- 
fluence on the theoretical re-evaluation of the 
role of color on reactions to inkblots (1, 2, 4, 
5, 7, 8), her findings are worth considering. 

Siipola cut out 20 colored portions of the 
original Rorschach test cards and photo- 
graphed them. The achromatic set was shown 
to 60 women while the chromatic set was shown 
to 72 women. Only the first conceptual response 
elicited spontaneously was used. The mean re- 


a i S 
ie ee author is now associated with the Stu- 
t Counseling Bureau, University of Minnesota. 


action time between the two groups for each 
card was compared. She found the chromatic 
cards required a longer mean reaction time 
than the achromatic set; only two exceptions 
occurred where the reverse was true. Unfor- 
tunately, no statistical test was computed to 
determine whether these differences might not 
be due to chance fluctuations. Since the hy- 
pothesis of hue-form incongruity leaned so 
heavily on this finding, mean latency of re- 
sponse scores—which are notoriously skewed 
—hardly suffices as an adequate support. In a 
recent study by Lazarus and Oldfield (5) 
which duplicated much of Siipola’s study, there 
was no clear-cut indication that the chromatic 
cards delayed the response significantly more 
than the achromatic mates. 

A question also may be raised regarding 
an interpretation Siipola placed on her data 
when the chromatic blots were found to be 
either more “pleasant” or “unpleasant” than 
the achromatic ones. She argued that such 
results indicated that colored blots were more 
“affect-laden” in the sense that they were 
more likely to arouse emotional attitudes dur- 
ing the process of responding (9, p. 366). 
Phillips and Smith (7) raised the question: if 
associative blocking and other disturbing emo- 
tional effects resulted from hue-form incon- 
gruity, how could Ss ever find such a process 
“pleasant”? Another interpretation is pos- 
sible; namely, that these affective states de- 
pended on whether the Ss were able or unable 
to give satisfactory responses to the cards. 
For example, with two cards equally saturated 
with a red hue, Siipola could not understand 
why one of these cards was found “pleasant,” 
the other “unpleasant.” Upon closer examina- 
tion of her data, it was found that the “un- 
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pleasant” card elicited four times as many 
rejected or deteriorated responses as did the 
“pleasant” card. Rather than utilize emo- 
tional attitudes during the process of respond- 
ing to explain these findings, it appears more 
likely that these attitudes resulted from suc- 
cess or failure: to respond. Indeed, Lazarus 
and Oldfield (5) found precisely this to be 
true. 

One of the difficulties Siipola encountered 
was to explain why hue-form incongruity at 
times did not effect any differences in the 
content of the responses for the two groups. 
In resolving this problem. she was led to 
postulate that when a card is “highly struc- 
tured,” color exerts no influence since the 
form is too compelling. While this reasoning 
may be accused of being circular, some of her 
data contradict this notion in that so-called 
highly structured cards had unusually long 
reaction time scores. Why should this be so? 
To argue that “Ss spent considerably more 
time searching in vain for a more congruent 
concept” at the same time you argue that 
highly structured forms are more compelling 
is to eat your pie and have it too. It is dif- 
ficult to measure card ambiguity using Ror- 
schach inkblots. Lazarus and Oldfield (5) 
tried to establish a criterion of nonambiguity 
by selecting those cards. regardless of whether 
they happened to be in a chromatic or achro- 
matic form, which elicited the same content 
in at least 77 per cent of the total responses 
obtained. We are not informed as to how 
many of the 36 cards met this criterion, nor 
why this cut-off point was chosen. 

In the present investigation, stimulus con- 
figurations were used which allowed a more 
varied yet thoroughly controlled use of hue, 
and at the same time provided for a clear 
determination of the degree of ambiguity of 
each card. The following hypotheses were 
then tested: 

1. The presence of hue in a configuration 
generally produces a significant delay in 
eliciting the first conceptual response. 

2. This delay in response is due to the 
incongruity that exists between the form and 
the hue of the figure perceived. 


3. Hue has a weak selective influence on 


the content of the response when the con- 
figurations are highly structured or nonam- 


biguous; but a strong, disruptive influence 
when the figures are poorly structured or 
ambiguous. 


Materials and Procedure 


The configurations used were taken from 
the Closure Test * developed by C. M. Mooney 
of McGill University. This test is similar to 
the Street-Gestalt Test to the extent that the 
figures are incompletely drawn in black and 
white, and Ss are required to perceive the ob- 
ject depicted in the configuration under re- 
duced cues. Figure 1 contains the 12 cards 
selected from Mooney's test for the present 
study. These cards were chosen because norms 
indicated they represented varying degrees ot 
ambiguity or structuredness. The index of 
difficulty was based on the proportion of 9S 
able to identify each figure correctly in the 
total configuration in the absence of color. 
If more than 50 per cent of the Ss were able 
to do this, the figure was called highly struc- 
tured; otherwi it was called ambiguous. 
(The index of difficulty for each card appears 
in Table 2.) 

Five sets of 12 figures each were used. 
Each set differed from the other sets in the 
hue applied to the white areas in each figure- 
Hues were chosen to represent the popular 
intervals of the color spectrum, and were ree 
green. yellow, and purple. The fifth set was 
achromatic. These 5 sets were identical 17 
every respect except for the variation in hues 
from set to set. Each configuration measure 
4 inches by 6 inches and was mounted mgr 
white cardboard background 7 inches by 
es of 

Two hundred and fifty undergraduates ns 
normal color vision, enrolled at the U 
sity of Maine, were the subjects. App ia 
mately half were women. The Ss Were ie 
domly assigned to one of the five groups 
Each S saw all 12 cards of a given hue. In this 
way, 50 Ss served in each of the 5 groups: 
Cards were presented in the upright position: 
one at a time, to each S. A sweep-second stop 
watch was started at the moment of cal 


a 


? This test may be obtained for experimental pur 
poses only from the Department of Psychology, Me 
Gill University. We wish to express our appreciatio” 
to this institution for providing us with sever 
copies of this test. 
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Fig. 1. The stimulus figures used in the experiment. $ 
pig or cow, (4) locomotive, (5) telephone, (6) male torso, (7) profile 
(10) full face, (11) logger with pole, 


figure seated on bench, (9) jockey on horse, 
holding child. 


Presentation. It was stopped when S made 
a definite, scorable response. The card was 
then removed and the next one presented 
until all 12 cards had been seen. This pro- 


ce ; : 
dure was used with all Ss. Instructions 
Were: 


They are (1) turkey on a plate, (2) three shoes, (3) 


of man’s face with hand on chin, (8) 
(12) couple or person 


be shown 12 incomplete 


subjects or 


You will 
common, at a 
time. They may be confusing when first seen be- 
cause some of the lines or shapes have been left out. 
However, aS you go on looking at each card you 
should expect to see some popular object, figure, or 


subject matter. Now, some of these pictures are 


pictures of 


everyday objects one 
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Table 1 


7 edian Reaction Time Score 
P tage of Ss in Each Group Offering Some Response At or Above the Median Reaction i 
ercentage of Ss in E 


Per cent at/above Md R.T. w 
Md — Chi j 
Cards (sec.) Ach. P R FY G Square =. 
ea ; vig 05-10 
ERER 20.5 46 36 5 a 8 8.48 Nah 
2. Shoes. 15.5 32 50: 42 4d p2 +94 ie 
3. Pig 20.5 2 46 54 52 56 2.72 an 
6. Torso 20.0 4 46 Gh 52 50 631 a 
7. Profile 12.8 6 42 4 62 46 10:62 ie 
9. Horse & Rider 12.4 48 48 54 42 60 3.7 : 
sii ea 8.0 48 48 50 52 56 1.89 me ee 
3. Telephone 6.3 46 52 36 50 64 res ae 26 
8. Seated 14.1 46 50 56 46 36 s ae 
10. Full Face 6.1 50 48 46 50 58 aS E a 
11. Logger 13.4 6 G2 54 52 4 3.5 at 
12. Couple 7.0 2 6 42 50 62 7.31 seein 
; s a A ach 
more difficult than others, and it’s possible you may sponse time score for each card in ea 


fail to see what is depicted. First impressions are 
probably best, so as soon as you recognize it, call 


it out so I may record your response. Have you any 
questions ? 


A time limit of 30 seconds was allowed for 
each card. If S failed to respond in this time 
interval, the card was taken up and the next 
one presented. No comment was made as to 
the correctness of the response. 


Results and Discussion 


Reaction time. A statistical problem usually 
arises when one attempts to deal with latency 
of response data. In the first place, such data 
rarely are normally distributed; in the sec- 
ond place, there are always Ss who fail to 
make a response to some of the cards. The 
statistical technique uniquely suitable for 
this type of data is the nonparametric Median 
Test (6). Using this statistic to determine if 
hue alone influenced the response when con- 
tent is ignored, it was found that only Card 
7 differentiated the groups significantly (chi 
square = 10.62, p= 92 — 05). All other 
cards failed to do so, as Table 1 indicates. 
Further analysis revealed that the yellow 
and achromatic cards were found to be sig- 
nificantly different from purple, red, and 
green, in“that'the latter hues had the shorter 
latencies. After determining the median re- 


group, a Median Test was computed for all 
12 cards as a group to determine whether ee 
had any over-all effect. Chi square was foun 
to be 6.44, df=4, p= .10 —.20. Similar 
treatment was accorded the cards when a 
into the categories of ambiguous and miet 
structured, but no significant color influence 
could be established statistically. F 
Since the above analyses were cangen 
with latency of response scores pegant n 
the conceptual response elicited, it was Tha 
portant to analyze these latencies E 
same correct conceptual response was 8! af 
by the various Ss in the 5 groups. Such ces 
analysis would control still further the ge 
fluence of color either as a disruptive ae) 
facilitative force in bringing about 4 ee 
response to the stimulus figures. Again, the 
Card 7 yielded a significant chi square at K 
OI level of confidence. It was found that he r 
the achromatic card had a significantly 0786 
latency than either purple or red. hat 
From these results, it js apparent tha 
stimulus hue generally did not delay responses 
as the first hypothesis postulated. In the tw 
instances where significant differences were 
obtained, either hue facilitated the responses 
or two different hues had differentially sig- 
nificant effects. Since Card 7 is essentially a” 


Influence of Color on Reactions to Incomplete Figures 


ambiguous card, the second and third hy- 
potheses are not supported. 

Content of response. Siipola contended “if 
a stimulus form is highly structured, color 
will normally have no effect upon the content 
of the conceptual responses regardless of 
whether the hue happens to be congruent or 
incongruent with the form-favored responses” 
(9, p. 374). On the other hand, if a stimulus 
form should be ambiguous, color could pro- 
duce novel concepts which otherwise were 
absent in the achromatic norm. Accordingly, 
the prediction follows that no differences 
should occur among the groups in their ability 
to recognize the figure depicted when the 
forms are highly structured; whereas, a dif- 
ference should be manifested in the number 
of correct identifications when the forms are 
ambiguous. Since the achromatic cards were 
“Jess constraining on the associative process,” 
they should elicit a greater proportion of cor- 
rect identifications than the chromatic cards. 

In Table 2, the data regarding the per- 
centage of correct responses obtained for each 
card among the various groups are presented. 
A chi-square test was computed for each card 
separately, and the corresponding p values 
indicate the levels of significance attained. 
Five cards yielded chi-square values below 
the .05 level of confidence. They were cards 
2 (shoes), 5 (telephone), 7 (profile), 11 
(logger), and 12 (couple). Two of these cards 
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were ambiguous, while three were highly 
structured. Apparently, degree of structure 
had little to do with this determination. 
Purple shoes were identified more often than 
yellow or red shoes; a profile in red was recog- 
nized more frequently than one in yellow; a 
red telephone was easier to see than a green 
one; a red logger was more difficult to see 
than a yellow or achromatic one; the couple 
was seen more clearly in red or achromatic 
than in purple. No particular color played a 
consistently superior or inferior role. 

When the cards were analyzed as groups 
based on degree of structure, significant dif- 
ferences were not found either for the highly 
structured cards or the ambiguous cards. 
These findings do not support Siipola’s hy- 
pothesis regarding the effects of color on highly 
structured or ambiguous cards. 

In Rorschach practice, the cliniciar always 
is concerned with determining the relative 
influences of form and color in eliciting every 
conceptual response. In analyzing the data in 
this study for content, the responses obtained 
for each card by all Ss were listed and com- 
pared. In substance, despite the variations in 
color used, rarely did any color differentially 
influence the content of the response. While 
there was a variety of content elicited, the 
kinds of content found in the achromatic 
cards generally turned up in all the chromatic 
groups. In only one single instance did a 


Table 2 
Percentage of Ss in Each Group Who Were Able to Perceive the Correct Figure in Each Card 


Per cent correct responses 


Cards Ach. P R l G Chi Square b 
Ambiguous sü oe 
Turkey 22 10 2 «12 10 . .10-.20 
2 Poa : % 36 To «14 20 wns Mai 
3. Pig go 4 2% 28 38 He a 
` 50 40 36 A0 52 i .30-.5 
an 38 9.48 05 
7. Profile 32 4 48 20 $ k os 
9. Horse & Rider 34 42 38 50 a 
Hi y 
a ss 36 46 54 46 5.80 20-30 
5. Telephone 60 50 70 50 46 18.61 a A 
8. Seated so W er db 6.86 10-20 
10. Full Face 80 72 82 76 74 1.92 í ~ 
11. Logger 6 s © ø F 9.44 d 
12. Couple 9 6 4% Boo A 13.01 02-.03 
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Table 3 


The Percentage of Ss in Each Group who Failed to Offer Any I 


sponse to Each Card 


Per cent rejected responses 


Cards Ach P R Y G Chi Square f = 
aoe kay 30-2002 3% 30 se 3030 
2. ‘Shoes 4 16 26 2 32 3.55 20-30 
3. Pig 36 28 46 4 46 n 10.20 
6. Torso 24 36 H 34 24 Gee 20.30 
7. Profile 34 18 16 30 22 5.28 01—02 
9. Horse & Rider 32 16 32 30 32 
e A i i u i ü 14 0.13 o P 
5. Telephone 14 12 10 2k 5.06 es 
8. Seated 22 22 36 30 36 4.70 gh 
10. Full Face i4 18 16 8s 20 ae 70-80 
11. Logger 16 18 26 24 20 1.87 30-50 
12. Couple 6 6 4 8 14 me a — 
ot alee 
given concept appear with significantly greater groups as to the number of baseman ei 
frequency in the chromatic version. On Card was found for the highly ee aaa 
1, when seen in green, 16 Ss called it a “leaf” With the ambiguous cards, only , se eab 
compared to 4 Ss in each of the other groups (horse and rider) differentiated the grot raple 
who saw it as a “leaf.” This was the only the .01—.02 level of confidence. The P the 
instance where hue pulled a conceptual re- hue contributed fewer rejections AM 
sponse in its direction. other hues, which in turn did not differ ejec 
It is important to note that while the ma- each other. These data indicate that ! ntly 
terials used in this experiment differed from tions do not necessarily occur more freque 
Siipola’s blots, and the Ss were told that a 


definite figure could be seen on each card, 
the essential task confronting Ss in both ex- 
periments was equivalent. While Siipola in- 
structed her Ss that “this is a test of your 
imagination,” she also instructed them as I 
would like to have you tell me exactly w 
and how you imagined what you did...” It 
is a mistake to think that the Rorschach test 
is a fantasy production in the sense that the 
reality features of the inkblots offer no con. 
straining rein on what Ss see. Even though 
the materials used in the present experiment 
are not inkblots, it was found that on the 
highly structured cards as many as 9 different 


concepts were given by Ss, while on the am- 
biguous cards 


11 different concepts. 
In the Siipola study, 
the chromatic blots we 
often as the achromatic 
statistically significant 


here 


it was reported’ that 
re rejected twice as 
blots. In Table 3, no 
differences among the 


because hue happens to be present. 


the average for each card was «eliciting the first con ; Ai 
Ta s&n This delay is due to the incong : 
a whic sometimes exists between the form 


: ‘ periments 
In view of the results of this experi! 


ai : ` oo. a rma 
it is the writers’ opinion that with no 


e 
i ar mor 
functioning Ss, form factors are far i 


Cola 5 ae +. eaen in # 
Significant in determining what is see! 
configuration than hue. 


sel- 

This study tested three hypotheses seem 

oped by Siipola to explain the alleged he 

turbance observed in some Ss clinically W ots" 
viewing the chromatic Rorschach inkbl¢ 

These hypotheses are: tio” 

1. The presence of hue in a configura ip 
generally produced a significant delay 


ceptual response. 


Í 

l] 

Summary and Conclusions | 
È 

the hue of the figure, ) 


n 
0 
3. Hue has a weak, selective mA . 
the content of the response in highly $ 
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tured figures, but a strong disruptive one in 
ambiguous figures. 

Incomplete figures taken from Mooney’s 
Closure Test were used. This created the ad- 
vantage of using figures which varied in de- 
gree of structure or ambiguity and allowed 
for a more varied and controlled use of hue 
which could be compared with the achromatic 
version. Five sets of 12 figures each were 
shown individually to 250 Ss randomly as- 
signed to one of the 5 groups. Since all sets 
were identical except for the variation in the 
hue of the figures, color influences as an in- 
dependent variable could be measured. 

Analyses of the data led to the rejection of 
all three hypotheses of Siipola. No significant 
differences were found among the groups on 
latency of the first conceptual response elicited 
except for one card where the achromatic 
form had the longer latency as compared with 
red and purple. Hue-form incongruity could 
not explain these differences. Hue had no sig- 
nificant influence on the content of the re- 
sponse as a function of the degree of card 
ambiguity. Also, the chromatic cards were not 
rejected significantly in larger numbers than 
were the achromatic cards. 

In brief, the findings of this investigation 
contradict the conclusions reached by Siipola 


yee ae 

Resex? on 

uEdnl. Oy ee ar 
ett ajina COLLEGE 


paving 4 
ij puted 
No 
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to explain the clinically observed disturbances 
of some Ss when viewing the chromatic Ror- 
schach inkblots. 


Received May 5, 1955. 
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Reliability of the Blacky Test’ 


Sol Charen 


Catholic University 2 


In a recent investigation of the concept of 
regression (2) use of the multiple-choice ques- 
tions in the Blacky test by Blum gave equivo- 
cal results. The research involved the test- 
retest of tuberculous patients at a period rela- 
tively early in their illness and again four 
months later in the final stage of recovery. 
The Blacky was the only instrument, in a 
battery of fifteen paper-and-pencil tests and 
the Rorschach, which gave a conflicting pic- 
ture with patients either showing no evidence 
on it of improvement or definite evidence of 
regression on recovery. 

Either the Blacky questions tapped per- 
sonality levels not reached by the other tests 
or did not have good reliability. The first as- 
sumption can be challenged by results of the 
Rorschach which showed only minor group 
changes when patients recovered. Even if 
Rorschach and Blacky tests are assumed not 
to tap the same levels of personality the re- 
gression in subjects which was shown by the 
latter test should have been reflected by 
changes in defenses or in ego structure and 


these changes would be picked up by the 
Rorschach. 


1An extended report of this study may be ob- 
tained without charge from Sol Charen, 200 Rhode 
Island Avenue, N.E., Washington 2, D. C., or for a 
fee from the American Documentation Institute. Or- 
der Document No. 4740 from ADI Auxiliary Publi- 
cations Project, Photoduplication Service, Library of 
Congress, Washington 25; D: Cy remitting in ad- 
vance $1.25 for microfilm or $1.25 for photocopies. 
Make checks Payable to Chief, Photoduplication 
Service, Library of Congress. 


7 Now at the Montgomery County Mental Hy- 
giene Clinic, Rockville, Maryland. 


Measurement of reliability of the Blacky 
was possible in view of the test-retest situa- 
tion and evidence from the other tests that 
no basic personality changes occurred during 
the four month period of recovery. eer. 
of the multiple questions accompanying each 
Blacky cartoon was by Blum’s criteria (1) 


he 
; m “ 
with each subject scored “weak” or “strong 


in various psychosexual areas. With this ei 
chotomy of results a point distribution SE 
be assumed and therefore r, was the correla 
tion coefficient used to determine reliability 
(3, p. 179). h 

The highest 7, obtained was .519 for Cas 
tration Anxiety (Picture IV) with the ema 
ing ones low or negative. Allowing for est 
relatively lower values of žo the ane 
correlations are still low enough to sugg b- 
that one reason for the equivocal results ye 
tained with the Blacky multiple-choice q" i 
tions in this study of regression in tuper 
lous patients might be due to the factor 
low reliability of this test. 


Brief Report. 
Received October 17, 1955, 
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Discriminative Powers of Rorschach Determinants 
in Children Referred to a Child Guidance Clinic 


Kennison T. Bosquet 


Providence Child Guidance Clinic and Brown University 


and Walter C. Stanley 


Brown University 


The present study sought to answer two 
questions: (a) What is the relationship be- 
-tween the ‘main Rorschach determinants and 
age in children, aged 7 through 13, who have 
been referred to a child guidance clinic for 
treatment? (b) How well do the Rorschach 
determinants discriminate between such re- 
ferred children and the “normal” children 
studied by Ames eż al. (1)? 

Though normative in character, our first 
question stemmed also from certain conven- 
tions which are used in the interpretation of 
children’s Rorschach records. These conven- 
tions consist of statements about changes in 
determinants as a function of age in normal 
children. Yet the literature contains relatively 
few normative studies, and those which have 
been published tend to be inadequate, par- 
ticularly for ages 7 through 13. Thus, the 
present study also raised a theoretical ques- 
tion: Do changes in the determinants, as- 
sumed to take place in normal development, 
Occur in children referred to a clinic? These 
hypothesized changes may be stated as fol- 
Ows: (a) there should be an increase In fre- 
quency with age in M, FC, F + %, P, and 
R; and (b) there should be a decrease in fre- 
quency with age in FM, CF, C, and A%. , 

Our interest in the second major question 
Was also twofold. By comparing the clinic 
Children with those studied by Ames, we 
Would have some basis for evaluating the 
Senerality of our findings on age as well 
to quis report is based on an M.S. thesis submitted 


autho University by the first author. The second 
°F served as advisor. 
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as information concerning the discriminative 
properties of Rorschach determinants. 


Method 


The Rorschach protocols of 175 boys who 
had been referred to the Providence Child 
Guidance Clinic for diagnosis and treatment 
were analyzed. Twenty-five Rorschach rec- 
ords for each of the ages 7 through 13 were 
selected at random from the Clinic files, con- 
taining Rorschach protocols which had been 
obtained and scored by the senior author as 
part of the routine testing program of the 
Clinic. 

The records were scored primarily accord- 
ing to the Beck (2) system, with certain 
adaptations from Klopfer’s (5) method. The 
main differences from Beck were the use of 
animal movement responses (FM), inanimate 
movement responses (77) and Klopfer’s F%, 
the percentage of form responses in the total 
number of responses. All records were ana- 
lyzed for the following 15 variables: R, M, 
FM, m, Total M, FC, CF, C, Sum C, Shad- 
ing, H%, A%, P, F%, and F + %. 

Intelligence ratings were available on 172 
of the 175 cases. The ratings were mostly 
Children’s Wechsler IQ’s; a few were Binet 
IQ’s. The mean IQ was 98.55; the sigma, 
17.98. The distribution was tested for skew- 
ness and found to be not significant. Thus 
the sample used in this study is representa- 
tive of the general population in terms of 
tested intelligence. 

One hundred fifty-three of the fathers of 
children in this study were alive. Chi-square 
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Medians and Quartiles of Scores on Major Rorschach Variables 


Kennison T. Bosquet and Walter C. Stanley 


Table 1 


Age 
Variable ile 7 8 9 9 1 Š = 
M 75 2 2 4 : 7 i i 
50 1 1 2 2 i 3 ; 
25 0 0 1 0 0 i : 
FM 75 2 3.5 4 4 3 6 3 
50 1 2 3 2 2 2 : 
25 0 1 1 0 i l ' 
m 75 0 1 1 0 ae ; 
50 0 0 0 0 0 2 o 
35 0 0 0 0 0 0 0 
Total M 75 4 7 8 715 6 7 6.5 
50 2 3 § 4 3 3 4 
25 1 1 2 1.5 1.5 2 2 
FC 75 5 1 1 1 1 2 5 
50 0 0 0 0 0 1 0 
25 0 0 0 0 0 0 0 
Cr 75 2.5 2 2 2 1 1.5 1 
50 1 1 1 1 0 0 1 
25 1 0 0 0 0 0 0 
€ 75 0 0 0 0 0 0 0 
50 0 0 0 0 0 0 0 
25 0 0 0 0 0 0 0 
Sum C 75 3 3 3.5 2 2 2.25 2 
50 2 2 15 1 5 1 1 
25 1 15 25 8 0 5 0 
Shading 75 2 2 2.5 2 1.5 2 2 
50 1 1 2 1 1 1 1 
25 0 0 0 0 0 1 0 
H% 75 27 25.5 25 19.5 19 19 22.5 
50 13 8 14 13 15 11 15 
25 75 0 8 8 7.5 7 y 
A% 75 64.5 615 67.5 675° us m 75 
3 50 52 50 62 62 60 63 
36 43 43.5 46 44.5 55,5 54.5 
pt 75 4 3.5 6.5 6.5 8 7 7 
50 3 3 5 5 5 5 5 
25 2 2 3 3 35 3 3.5 
FY 75 73 65.5 68 71 78 
50 64 58 54 59 mi 2 58 
25 46.5 385 39 42 54 44 52.5 
FAG 75 75 74 84 88 89 85 88 
50 63 65 75 80 80 71 79 
25 55 46.5 -62 65 60.5 67 66 
R 75 17 20.5 25 23.5 24 23 22 
50 15 16 18 17 18 17 16 
25 u * 415 13.5 135 13 12 10.5 
* Chi-square median test 


** Chi-square median test 


b value between .02 and .01, 
$ value less than .01, 
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tests revealed that they did not differ sig- 
nificantly in socioeconomic status from em- 
ployed males in the state of Rhode Island, 
as listed in the 1950 census reports (7). 


Results 


Since few of the distributions of Rorschach 
scores were normal within age groups, chi- 
square tests of independence were used to 
test null hypotheses. The over-all median of 
the 175 scores for each variable was used to 
divide each age level into two groups, one be- 
low the median and one above. A 2 X 7 table 
was thus obtained for each variable. The hy- 
pothesis tested for each variable was that the 
age groups came from a population with a 
common median, 

Table 1 gives the median and quartiles for 
each age group on each Rorschach variable 
and summarizes the results of these chi-square 
comparisons. Three variables achieved sta- 
tistical significance. These are P, F + %, and 
A%, all of which increased with age. 


Comparison with Ames’s Data 


The study of Ames e¢ al. (1) was made on 
a group consisting primarily of children of 
the research group which had been followed 
for many years at the former Yale Clinic of 
Child Development. This group was supple- 
mented with children of similar intelligence 
and social class levels from the Connecticut 
cities of New Haven and Waterbury. Fifty 
children, 25 boys and 25 girls, were seen at 
each of 13 different age levels. The children 
were considered to be a “normal research 
group.” Only those in the age range 7 through 
10, a total of 200 children, were used for 
comparison with the Clinic sample of the 
Present study, as these were the only ages in 
which the two groups overlapped. . . 

The distribution of intelligence ratings in 
the Ames group shows three-fourths of the 
children to be above the “average” category, 
With the median and modal ratings being 
Superior,” The Clinic children, on the other 
and, show a fairly normal distribution with 
ni Median and mode within the “average” 
p cory. The two groups differ significantly 

Mtelligence, the chi-square p value being 


less than .01, with the Ames group being 
much higher in rating. e 

The Ames group was a “high-level popu- 
lation with more than half the children in the 
professional group, and three-fourths in the 
professional and managerial groups” (1, p. 
24). Ratings were based on the Minnesota 
Scale of Paternal Occupations (4). The Clinic 
children rated on the same scale show only 
15 per cent in the professional and mana- 
gerial groups and about three-fourths in 
groups comprising clerical, retail business, 
skilled and unskilled trades. The hypothesis 
that the clinic and the Ames groups were 
drawn from the same socioeconomic popula- 
tion can be rejected, the chi-square Pp value 
being less than .01. 

Ames’s data on Rorschach variables in- 
clude both boys and girls, while data of the 
present study are limited to boys. However, 
Ames comments, “Sex differences are mini- 
mal at most of the individual ages studied 
and are not for the most part consistent from 
age to age? (1, p. 288). Accordingly, the 
Clinic and Ames groups were compared on 
the 10 Rorschach variables where scoring 
was comparable by means of a chi-square 
analysis. The 10 variables were M, FM, FC, 
CF, C, Sum C, H%, A%, F%, and R. 

The hypothesis tested at each age level for 
each variable was that dividing the Clinic 
and Ames age groups on the basis of the 
Ames age group medians yields frequencies 
independent of the Clinic-Ames classification. 
The 10 variables compared at the four ages 
gave 40 chi squares, of which three had p 
values between .02 and .01, and 37 had p 
values of .20 or more. For the three “signifi- 
cant” differences, the Clinic group had more 
FM responses at age 9; a lower F% at age 
9, and a higher A% at age 10. Inspection of 
Wilkinson’s (6) tabled values for obtaining 
p values of .05 and .01 in a set of four in- 
dependent tests reveals that these three chi 
squares are indicative of “real” p values of 
approximately .05. However, it should be 
mentioned that in the case of F% and A%, 
the direction of difference between the Clinic 
and the Ames age groups was not the same 
for the four age comparisons, thus prevent- 
ing any simple interpretation oy even these 
“corrected” p values. 
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A second set of chi-square tests of inde- 
pendence of the Clinic-Ames classifications 
was based on the number of children using a 
determinant one or more times. In this com- 
parison only the Ames data for boys were 
compared with the Clinic group since the 
Ames data were broken down according to 
sex. However, the number of variables in- 
volved was smaller, as only those so listed 
and scored comparably by Ames could be 
used. The variables were M, FM, FC, CF, 
and C. 

These five variables compared at four dif- 
ferent age levels gave 20 chi square, of which 
one (that for C, Age 7) had a p value of 
about .02, and 19 had p values greater than 
05. The chi square for C, Age 7 is not re- 
liable as one such value in a set of four. 

In a further comparison based on children 
using C one or more times, the four age 
groups were lumped and the Clinic boys were 
compared with the Ames boys in a single 
2X2 table. This comparison yielded a chi 
Square with a p value of about .02, the Clinic 
group having the higher scores. 


Discussion 


It is evident from the findings with the 
Clinic children that the 15 Rorschach vari- 
ables analyzed showed a marked insensitivity 
to the age variable. Significant p values ob- 
tained only for P, F + Jo, and A%, each of 
which showed increases with age. It should be 
noted, however, that the first two of these 
variables are statistical in derivation and are 
in this study based on adult norms. 

The third significant increase (A%) is just 
opposite to the conventional assumption in 
regard to “normal” children, and might be 
explainable by the nature of our sample— 
referred children. However, when this clinic 
group was compared with the Ames sample, 
there was no significant over-all difference. 
This suggests that even with “normals,” A% 
may not decrease as commonly assumed 
throughout the ages studied. 

With regard to the nine conventional as- 
sumptions concerning the effect of age on de- 
terminants which were listed in the introduc- 
tion, the data on the Clinic group affirm the 
applicability of two (that P and F+% 


should increase), negate the applicability of 
one (that Aço should decrease), and provide 
neither confirmation nor negation for the re- 
maining six conventional assumptions. : 

Again, one way to treat these findings 
would be to dismiss them on the ground that 
our subjects came from a Clinic population, 
hence were abnormal in personality develop- 
ment. An alternative explanation, however, E 
suggested by the striking similarity in eet 
schach scores between the Clinic group an 
Ames’s “normal” research group. These av 
groups, it will be recalled, differed rae ley 
in intelligence, in socioeconomic status, an 
in the fact of referral to a child guidance 
clinic, yet the only indication of a real over- 
all difference came from one of the Le 
analyses involving C. The alternative imp = 
cation of our findings, then, is that a ot | 
“sign” approach to the interpretation of w 
dren’s Rorschach responses is relatively inse E, 
sitive either to age or to differences beneri 
markedly contrasting groups of children. T ct 
conclusion is further buttressed by the we 
that the mean value for F -+ % for 7-ye4 
old Clinic children was 65.84. Bochner 2 
Halpern (3) state that an F + % of 65 ca 
be expected in a child just reaching sch 
age. 


Summary A 

The Rorschach protocols of 175 om 
boys, 25 at each age, 7 through 13, were en 
lyzed for changes in 15 Rorschach deens q 
nants. Only three, P, F + %,; and AJo, sho ase 
significant changes with age, all three increa? 
ing with age. Insofar as scoring proce de- 
was comparable, scores on the Rorschach ©” 
terminants for this Clinic sample were C° 
pared with the scores reported by Ames et 
for a “normal research group.” ‘Although f 
Clinic sample was significantly poore! of? 
intelligence and socioeconomic status, its * as 
schach responding, taken as a whole, i 
strikingly similar to that of the Ames grouk 
It was suggested that the major implicat a” 
of the present study was that the t 
approach to the interpretation of childre i] 
Rorschach responding is a relatively inse” 
tive procedure. 
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Word Association Frequency Tables of 
Mentally Retarded Children’ 


Edmund M. Horan 
New York, N. Y. 


No adequate word association frequency 
tables have been available for the measure- 
ment of group contact in children. The chil- 
dren’s tables published in 1916 by Woodrow 
and Lowell reported the responses of children 
as a group with no separation into age groups. 
Moreover, the method employed in their in- 
vestigation was not oral but written. 

The oral responses of 732 mentally re- 
tarded children, or a total of 73,200 responses, 
are reported in this study. The frequency 
tables, based on the Kent-Rosanoff stimulus 
set of 100 words, have been arranged by 
chronological age, nine 
clusive. The children w 
class personnel sheets a 
dren with Retarded 
New York City. Th 
based on individua 
chologists from the 


In comparing agreement of favorite re- 
sponses between children of average intelli- 
gence (Woodrow and Lowell—written re- 
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sponses) and adults (Kent and Rosanoff 
—oral responses), and between the retarded 
children of this study and adults, the favorite 
responses of the retarded children overlapped 
more with those of the adults. In this com- 
parison, the tenth and twelfth years of the 
retarded children seemed critical because of 
the significant increase made in the number 
of their favorite responses toward the adult 
level. 

The present investigation found a much 
closer similarity between children’s associa- 
tions and those of adults than did Wood- | 
row and Lowell. Differences do exist but the 
differences are not found in the manner of 
associating, but, rather, in the tendency of 
children to offer a greater number of unique 
responses, to use more different words in re- 
sponse to a stimulus and, at times, to be 
unable to respond to a stimulus word. 

Word meanings play a part in the forma- 
tion of associations, but not as important 2 
part as has been thought. Responses by OP” 
Posites appear as favorite responses at 4 
much younger age than has been believe? 
High written-word frequency does not ap 
Pear to give a stimulus word any speci4 
Power in word association. 

A comparison of the responses of each 4 
group of retarded children demonstrates # 
uniform decrease from nine through fourtee™ 
inclusive, in the number of failures of 1° 
sponse and unique responses, and a concur 
Tent increase in the number of common 1° 
Sponses, i.e., responses with a frequency ° 
two or more. 


ge 
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Examiner Influence in a Testing Situation! 


Thomas A. 


Wickes, Jr. 


Purdue University 


A number of investigators (1, 2, 3, 5, 6) 
have studied examiners and the effects ex- 
aminers have on the results they elicit from 
examinees. These studies have been done 
within different contexts and from different 
points of view but they all point up the fact 
that the examiner can, in various ways, af- 
fect the results they get from examinees. 
Nevertheless, some examiners tend to treat 
certain aspects of the testing situation as if 
they were unimportant and thus disregard 
their possible effects upon gathered data. The 
present study was designed to see whether or 
not test results could be modified by some 
aspects of the testing situation which are 
sometimes treated as if they were unimpor- 
tant. The experimental hypotheses tested 
were: (a) test results will be significantly 
modified by the perfunctory, verbal com- 
ments, “Good,” “Fine,” and “All right.” (b) 
test results will be significantly modified by 
the perfunctory, nonverbal actions of smiling, 
nodding the head, and leaning forward in 


the chair. 


Procedure 


Thirty-six male students ranging in age 
from 18 to 23 years were used in the study. 
These students were enrolled in introductory 
Psychology classes at Purdue University. Stu- 
dents were placed in one of three groups, each 
group consisting of twelve subjects. Hypothe- 
Sis a was tested in one group; hypothesis b 
Was tested in another group; and the third 
8toup served as a control. 


ti 1 This Paper is based on a thesis submitted in par- 
1, fulfillment of the requirements for the degree of 
memoi Science, to the Graduate School of Purdue 


niversity, Th i Prof. A. W. 
Lan daea e study was directed by Pro 


Two examiners were used in the experi- 
ment. Each examiner tested six subjects in 
every group. The author and the second ex- 
aminer both had similar training and experi- 
ence in psychology and in scoring inkblot re- 
sponses via Klopfer’s method. Both examiners 
practiced voice inflections, posture, and move- 
ments so that these conditions would be as 
nearly equivalent as possible in the experi- 
ment. 

“Test results” in the experiment were de- 
fined in terms of movement (M) responses 
i.e., the inkblot induced perception of action 
in humans (excluding internal parts) and/or 
human-like action in animals or parts of ani- 
mals. The test instrument was a set of 30 
achromatic inkblots, devised by the author 
and several of his colleagues, which had been 
selected by means of a pilot study from an 
original series of 120 blots. These 30 ink- 
blots consisted of two series of 15 blots each, 
numbered 1A, 2A, ... 15A and 1B, 2B, 
ow « LSB. 


Both A and B series of blots were composed of 
five blots which elicited movement responses be- 
tween 45 per cent and 50 per cent of the time in the 
pilot study and ten blots which elicited movement 
responses between 20 per cent and 25 per cent of the 
time in the pilot study. Those five blots in each 
series which elicited the most movement were pre- 
sented first. 

In the testing situation, the subject was conducted 
to a small well-lighted testing room and was asked 
to seat himself in a chair at the right side of the 
desk, adjacent to, and facing the examiner. After 
certain preliminaries had been completed (asking the 
subject to withhold questions, checking him off the 
appointment sheet) the instructions were read to him 
as follows: “I am going to show you some cards 
with ink blots on them. I want you to tell me what 
one thing it looks most like to you, or reminds you 
of. Please look at each card carefully, turning it so 
that each of the four sides is toward you” At this 
point, the experimenter gave a demonstration in 
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i icked up a blot and looked at it from 
a at Ge at des. “Take all the time you wish, 
then tell me the clearest thing you see. When you 
finish, hand me the card and I will write down your 

sin 

ao the subject indicated that he understood the 
instructions, cards 1A to 15A were presented to him, 
one at a time. After each response, the subject 
handed the card to the examiner who then recorded 
the response. During the presentation of the first 15 
cards, the examiner remained in one position as 
nearly as possible, moving only his right arm to 
handle the cards and to record the response. Sub- 
jects in all three groups were treated in as nearly 
identical a manner as possible during the adminis- 
tration of the first half of the thirty-card set. How- 
ever, during the second half of the thirty-card set 
(i.e. cards 1B to 15B) variation was introduced in 
two of the three groups. 


In the first experimental group or the verbal 
condition group the examiner made a com- 
ment after each M response, starting with 
card 1B. With the first M response the ex- 
aminer said, “Fine.” On the next M re- 
sponse the examiner said, “Good.” After the 
third M response the examiner said, “All 
right.” These comments were repeated in that 
order after each M response throughout the 
Temainder of the series, No other comment 
was made and the examiner controlled his 
body movements except for tendering the 
card, recording the response, and receiving 
each card as it was returned. 

In the second experimental group or non- 
verbal condition group, the examiner modi- 
fied his behavior after each response judged 
to be M, starting with card 1B. After the 
first M response, the examiner nodded his 
head three times. On the next M response the 
examiner smiled. With the third M response, 
the examiner leaned forward in the chair right 
after the response, recorded it, and returned 
to the initial position. These behavioral modi- 
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fications were repeated in that order after 
each M response throughout the remainder of — 
the series. No other movement was made and > 
the examiner made no comments unless asked — 
a direct question and an answer was un- 
avoidable. s r 

In the control group, all thirty cards, 1/ 
through 15B, were administered to each sub- 
ject in a manner as nearly identical as pos- 
sible. 

Immediately after the subject had ~ 
sponded to the last card, the examiner aske 
him to fill out a short questionnaire. The ae 
pose of this questionnaire was to get a roug 
estimate of the subjects’ attitudes toward the 
test and the experimenter. The subjes 
anonymity was safeguarded in this phase gi 
the experiment. After the subject had filled 
out the questionnaire, the examiner ie 
viewed him to determine whether or not H 
had been aware of the nature of the eapo ] 
ment. It may be inferred from the intervie 
data that none of the subjects was cognizan 
of the nature of the experiment, at least # 
the verbal level. 


Results 


i 
Prior to analyzing the data, the anhor ook 
cluded four subjects who gave no M respo on- 
to the last 15 cards under the verbal and pe 
verbal conditions. The total number in € i- 
group was then eight in the verbal ent 
tion group, eleven in the nonverbal condi 
group, and twelve in the control group. ed 
In analyzing the data, the procedure cl 
to compare the mean number of M ok 
elicited by the first 15 cards to the ™ pi 
number of M responses elicited by the seco m 
15 cards. This was done for all three group” 
As recommended by McNemar (4, pp- ? 


Table 1 


Difference Between Correlate 


d Means ¢ Test for Verbal Condition, 
Nonverbal Condition, and Control Con 


dition 


SD of distr. of 
diffs. between 


Significance level 


Computed — T 

Group N paired scores t 1<.025 4<.005 
Verbal condition 8 3.04 2.90 2.36 3.50 
Nonverbal condition 11 1.25 7.47 2.23 3.17 
Couitroi condition 12 1.63 1 2.20 3.11 
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Table 2 


Difference Between Uncorrelated Means ¢ Test for Examiners in Verbal Condition, 
Nonverbal Condition, and Control Condition 


Mean of M diff. 


Significance 


Condition and No. score for each Computed level 
examiner tested examiner i 1<.05 
Verbal condition 
Examiner I 5 4.40 
Examiner IL 3 1.67 1.49 2.36 
Nonverbal condition 
Examiner I 7 2.71 
; 35 9.9 
Examiner TI 3.00 39 2.23 
Control condition 
Examiner I 6 83 
7 ie. 
Examiner IL 6 1.67 46 2.20 


226), the test of significance used made al- 
lowance for the fact that the two sets of 
scores were not random with respect to each 
other. The appropriate statistic in this case 
was the ¢ test of difference between correlated 
means, Table 1 gives the results of this t test. 

As can be seen from Table 1, the differ- 
ence between the mean number of M re- 
sponses seen in the first 15 cards and the 
mean number of J responses seen 1m the 
second 15 cards in the verbal condition group 
was significant beyond the .025 level. The 
difference between the mean number of M re- 
Sponses seen in the first 15 and the last 15 
cards in the nonverbal condition group was 
significant beyond the .005 level. There was 
no significant difference between the first and 
last halves of the cards in the contral condi- 
tion group. ; 

To gauge the effect the examiners, per se, 
might have had in eliciting M responses from 
the subjects, a ¢ test was executed between 
the examiners, Essentially, this was 4 ¢ test 

etween uncorrelated means such as 1S Se 
lined in McNemar (4, Ch. 12). It involve 
testing the hypothesis that there was nO sig- 
nificant difference between the means of the 
difference scores obtained from the ii 
OUS subjects tested by each examiner 17 eac 
8toup. Table 2 gives the results of this t test. 
sen PON examination of Table 2, it can be 
ĉen that there was no significant difference 
StWeen the examiners in any of the three 
Soups, That is, one examiner did not seem 


to draw more Jf responses from his subjects 
than the other examiner. 

The questionnaire or opinion sheet, as in- 
dicated previously, was designed to gain only 
a rough estimate of the subjects’ motivational 
involvement in the testing situation. The re- 
sults of the questionnaire indicated that ap- 
proximately 90 per cent of the subjects in 
both the experimental and the control groups 
had a high degree of interest in both the ex- 
perimenter and the experiment. It was felt 
that these conditions led to a set toward, or 
an involvement in the situation conducive to 
optimal results. 


Discussion 


The hypothesis that test results will be in- 
fluenced by what the examiner says and does 
more or less routinely in the testing situation 
seems to have been substantiated, at least in 
terms of this experiment. In interpreting these 
results, it should be kept in mind that the 
samples used were small, but that the differ- 
ences obtained in these small samples had to 
be proportionately larger before the chosen 
significance level could be reached. 

Since the assumptions underlying the sta- 
tistics used are difficult to demonstrate, it 
does not seem entirely legitimate to assume 
without further study that given a different 
population and/or different tests, the results 
would be the same. However, using the pres- 
ent study as a predictive basis, it is indicated 
that examiners need to be more careful of 
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what they say and do, in a perfunctory man- 
ner, when they are engaged in testing. At 
least, they should be cognizant that even un- 
der what would be assumed to be “stand- 
ardized” conditions, it is possible for their 
behavior to be reflected in the test results. 


Summary and Conclusions 


This experiment was designed to test the 
general hypothesis that test results will be 
modified by those aspects of the testing situa- 
tion which are sometimes not carefully con- 
trolled or are treated as if they were unim- 
portant. Thirty-six male subjects in two ex- 
perimental groups and one control group were 
used to study the effects of perfunctory verbal 
comments and nonverbal actions on test re- 
sults. The findings of the study suggest that 
such comments as “Good” or “Fine” and such 
actions as smiling and nodding by examiners 
have a decided effect upon test results. Thus 
it was indicated that examiners should be 
alert to the fact that even under presumably 
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“standardized” conditions, it is possible for 
their behavior to be reflected in test results. 


Received May 13, 1955. j 


References í 


1. Gibby, R. G, Miller, D. R, & Walker, E. L. The | 
examiner's influence on the Rorschach proto- 
col. J. consult. Psychol, 1953, 17, 425-428. | 

2. Greenspoon, J. The effect of verbal and mechani- 
cal stimuli on verbal behavior. Personal com- 
munication, 1954. 

3. Marine, E. L. The effect of familiarity with the 
examiner upon Stanford-Binet test perform- 
ance. Teach. Coll. Contr. Educ, Columbia 
Univer., 1929, No. 381. k 

4. McNemar, Q. Psychological statistics. New York: 
Wiley, 1949. E f 

. Sacks, E. L. Intelligence scores as a function es 

experimentally established social relationship 
between child and examiner. J. abnorm. $0 
Psychol., 1952, 47, 354-358. A 

6. Schachtel, E. G. Subjective definitions of the ROF 
schach test situation and their effect on ue 
performance. Contributions to an understa? 
ing of Rorschach’s test, III. Psychiatry, 194 
8, 419-448. 


w 


Journal of Consu 


o lting Psycholo 
Vol. 20, No. 956 j e 


It 


The Relationship Between the Inferential Potential 
of Rorschach and TAT Protocols 


Leon H. Levy, Janice 


Indiana 


A problem frequently faced by the clinician 
in diagnostic work is that of deciding when 
to stop testing and when to continue. This is 
particularly true in those instances where the 
client has produced one test protocol which 
might be said to be low in inferential poten- 
tial, i.e. a protocol which does not seem to 
lend itself to the derivation of meaningful 
clinical hypotheses. The problem investigated 
in this article might be stated in the form of 
the question: Given a test protocol of a cer- 
tain relative level of inferential potential by 
a particular S, to what extent might one ex- 
pect a second and different test protocol to be 
of the same relative level? Stated somewhat 
more elegantly, we are interested in the extent 
to which the variance in inferential potential 
might be accounted for by the individual sub- 
ject (S) and by the subject-test interaction. 

If it were found that the individual S ac- 
counted for a major portion of the variance, 
i.e., if one could predict inferential level from 
One test protocol to the next for any par- 
ticular S, then there would be some basis for 
deciding whether to continue oF discontinue 
testing on the basis of tests already adminis- 
tered. If, for example, the S a rather 
Sterile Rorschach, he might b 
€nsive” and sent on his way; 
decided that the TAT would 
= choice with him. If, on the othe 
ae found that the subject-test interaction 
me aad for the major portion of the ye 
ine then there would be no way of Pre oA 

oe potential from one test to the 
eve, and one would be justified in trying 
it al tests until one was found which per 

ed an adequate formulation of the case. 
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Method 


The Rorschach and TAT were the two 
tests used in this study. Twelve cases were 
pulled from the clinic files which met the 
following criteria: (a) each folder contained 
a Rorschach and a TAT administered by the 
same examiner at the same session, and (b) 
the same examiner administered the tests in 
all of the cases. In addition, only male col- 
lege students were used. In this way it was 
hoped to minimize any effects of examiner 
differences, changes in attitudes, range of tal- 
ent, etc. The cases were selected from the 
files by the clinic secretary who was unaware 
of the purpose of the study. All Rorschachs 
and TAT’s were then pulled from the case 
folders and coded. 

Because of the complexity of the criterion, 
it was decided to use the paired-comparisons 
method in arriving at rankings of protocols 
on relative levels of inferential potential. Thus 
all twelve Rorschachs were ranked by means 
comparisons and then correlated 
by means of rank-order correlation with the 
twelve TAT’s similarly ranked. Judges were 
instructed to indicate which protocol of each 
pair they felt would permit them to make a 
larger number of inferences about the per- 
sonality of the person producing the proto- 
col. In order to measure interjudge agreement 
three judges were used: Judge A ranked both 
Rorschachs and TAT’s, Judge B ranked only 
the Rorschachs, and Judge C ranked only the 


TAT’s. 


of paired 


Results 


nce correlations were calculated 


Rank-differe 
imate interjudge agreement as 


in order to est 
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well as the relationship between relative level 
of inferential potential on the two tests. In 
each case their statistical significance was 
tested by reference to Olds’s (1) tables of 
the distribution of sums of squares of rank 
differences. 

The value of rho for Judges A and B on 
Rorschach rankings was .94 while the tho be- 
tween Judges A and C on TAT rankings was 
-92. Both of these are significant at the .01 
level. Because of the apparently high level of 
agreement between judges, the ranking of 
Rorschachs and TAT’s on relative level of 
inferential potential was based on the com- 
bined rankings of the two judges for each test. 
Rho between Rorschach and TAT rankings 
was .65 which is significant at the .02 level. 


Discussion 


The data seem to indicate that the judges 
were in agreement with each other in their use 
of the criterion of inferential potential, This 
of course does not imply that had they each 


test to another for any given S. 

To the extent that these findings may be 
generalized to other Populations, their prac- 
tical implications are fairly obvious, viz., that 
where one has obtained a Rorschach (TAT) 
which is fairly barren in dia 
cance, there is little point in administering a 
TAT (Rorschach) in the hope that Perhaps 
this test will do the trick. They fail to sup- 
port the assumption sometimes made that the 
more tests we have on the individual the 
more we are likely to learn about him. 
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Theoretically, these findings raise several 
interesting issues. For one thing, it may well 
be that one of the most diagnostically signifi- 
cant findings in a particular case is that the 
S produces a protocol either high or low in 
inferential potential, ie., we may be dealing 
here with an important personality variable. 
Research directed along these lines attempt- 
ing to determine the behavioral correlates of i 
this variable may go a long way toward en- 
hancing our understanding of personality and 
reducing the clinician’s feelings of inadequacy 
when he comes up against a client who 
“doesn’t give,” E 

Another issue is the economic one. The cli- 
nician faced with the task of evaluating 4 
client usually has only a limited amount of 
time in which to accomplish this objective. 
How can this time be spent most profitably? 
Our findings provide no answer to this ques , 
tion other than a negative one. It would e 
though that some criterion, undoubtedly muc 
more elaborate than that used in this study? 
might be employed so that the clinician could 
decide when he has reached the point of @ 
minishing returns with a client. 


Summary 


Judges ranked 12 Rorschach and TAT Pal 
tocols on the basis of their relative inferenti 
Potential. A significant relationship was fou? 
between the two tests and this was interp si 
as indicating that the individual S accoun 
for a major portion of the variance in el 
ential potential. Certain practical and the 


CE lene ag rs 3 is- 
retical implications of these findings were di 
cussed, 
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Dependency Themes on the TAT and 
Group Conformity’ 


Jerome Kagan and Paul H. Mussen 
The Ohio State University 


Many personality theorists use the concept 
of “dependence” in explanatory formulations 
and clinicians often make statements about 
the strength or intensity of an individual's 
dependent needs. Although the specific be- 
havioral referents for this concept have not 
been explicitly or unambiguously defined, 
there is probably general agreement that de- 
pendent tendencies include “the need for 
emotional or authoritative support in most 
Situations, difficulty in making independent 
decisions and taking on responsibilities and 
the dread of loneliness” (5, p. 392). 

This statement implies that the dependent 
Person perceives others as more competent 
than he, and he is likely to seek and accept 
the guidance and advice of others when he 
has to make a decision. Since the dependent 
individual would regard the opinion of a 
Stoup as wiser and more reliable than his 
Own, it might be predicted that he would con- 
orm with group judgments. Thus, if the 
tendency to conform to group opinion is ac- 
cepted as one behavioral referent for depend- 
€ncy, clinical evaluations of this character- 
'stic could be validated by correlating the 
Mnical measures with group conformity be- 
Navior, 

n Thematic Apperception — 
enp, 2S & technique for evaluating 
tial strengths of various motives and there 
Met been numerous attempts to relate the 
ha ds revealed in TAT stories to overt be- 

Vior, 

t Apparently, the relation 
ig Y needs and corresponding ove 
etter for some motives than 


Test is often 
the differ- 


ship between fan- 
rt behavior 
for others. 


assistance 
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Murray (6), studying a group of college men 
obtained correlations of over + .40 heiwoen: 
TAT fantasies involving nurturance and pas- 
sivity and overt behavior ratings of these 
variables but found correlations of near zero 
between sexual and aggressive needs and their 
corresponding overt behaviors. 

Sanford (9) and Tompkins (10) have sug- 
gested that if the motive in question is pro- 
hibited or punished in the individual’s social 
milieu, e.g., aggression or sex in the middle 
class, there is apt to be little or no relation- 
ship between the strength of the fantasy need 
and the corresponding overt behavior. Thus, 
Bach (2), Korner (4), Pittluck (8), and San- 
ford (9) did not find direct relationships be- 
tween the amount of aggressive TAT or doll 
play fantasy and the strength of overt ag- 
gression among children or adults. 

On the other hand, if the motive in ques- 
tion is culturally sanctioned, there is more 
likely to be a positive relationship between 
fantasy and overt expression. Thus, Mussen 
and Naylor (7) found a positive relationship 
between TAT fantasy aggression and overt 
aggressive behavior among boys of the lower 
class, for whom such behavior is often ap- 


proved. 
Dependent behavior, also, has some cul- 
anction, for seeking advice or help in a 


tural s 
problem situation is often encouraged and 
praised. For this reason one might predict a 


more direct relationship between dependent 
fantasy themes and overt dependent behav- 
jor. The present research was designed to test 
the hypothesis that there is a positive asso- 
ciation between TAT dependency themes and 
the tendency to adopt objectively inaccurate 
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group judgments in a situation where there is 
strong social pressure favoring conformity. 


Method 


The subjects were 27 male undergraduates 
enrolled in the elementary Psychology course 
at The Ohio State University. Their ages 
ranged from 17 to 31 years with a mean of 
21.6; 

In the first part of the experiment, each 
subject was instructed to write stories in re- 
sponse to eight TAT cards from the Murray 
series in a prescribed order (1, 6BM, 7BM, 
3BM, 12M, 13B, 14, and 18BM). He was 
told to make each story about a half a page 
long but not to write for more than two or 
three minutes on each card. Previous research 
(3) indicates that there are no important 
differences between the thematic contents of 
written and oral TAT stories, 

After he completed the TAT, the subject 
was asked to cooperate in a seven- or eight- 
minute experiment on vision, conducted by 
another experimenter who needed additional 
subjects. This second situation was identical 


tions 
This is a task which involves the discrimination of 
lengths of lines. You see 


The naive subject was always seated fourth 
from the right and was always the fourth per- 
son to call out his judgment. When all five 
subjects had stated aloud their judgments on 
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one pair of cards, these two cards were re- 
moved and replaced by a new pair with new 
standard and comparison lines. This was ie 
peated 12 times with 12 different pairs 0: 
cards. The measurements of the standard and 
comparison lines were identical with those 
used by Asch (1). p 

The four men cooperating with the experi- 
menter had been previously instructed to an- 
nounce correct answers on five trials (1, 2, 
5, 8, and 11) and to announce incorrect an- 
swers on the other seven trials (3, 4, 6, wa 
10, and 12). On each of these seven enue A 
trials, all four announced the same incorrec 
answer and constituted a majority opinion. 

The TAT stories were analyzed for tw? 


Ss 
types of themes suggesting dependency need 


f m 
Themes in which the hero sought help ~ 
another individual in solving a personal pro 


: t rce 
lem or was disturbed over the loss of a sou 


of love and support were classified as D. ciad 

It should be noted that D themes are simi- 
lar to those which Murray considers ingia 
tive of n Succorance. Only one D theme W 
scored for each story. ed 

The second category, d themes, were spo 
when the hero was given some help or sa 
(advice, food, money, etc.) which was m 
specifically requested. This type of s $ 
closely related to Murray’s category 0 ase 
nurturance, is probably a more indirect me ns 
ure of dependency, However, some ee 
might argue that stories in which the hero r 
ceives unsolicited nurturance reflect the st? 
teller’s dependency needs. the 

All stories were independently scored by v 
authors without knowledge of the siber 
group conformity behavior, Percentages 
agreement for D and g themes were 93 pe 
95 per cent, respectively, indicating that 
Scoring system was highly reliable. 


Results 


Sixteen of the 27 subjects conformed to A 
incorrect stoup judgment on one or more á 
the seven crucial trials. The number ip 
“yields” per subject (conformity with the x 
correct judgment) ranged from zero to seV' 
with a median of one for 


e! 
There was no significant difference betwe 


= 


the entire grouP 
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Table 1 


Distribution of “Yielders” and “Nonyielders” Among 
Subjects High and Low in D Themes 


D Themes 
Group High Low 
Yielders 10 6 
Nonyielders 0 11 


x? = 8.52, p <.01. 


Table 2 


Distribution of “Yielders” and “Nonyielders” Among 
Subjects High and Low in d Themes 


d Themes 
Group High Low 
Yielders 9 7 
4 7 


Nonyielders 
are) a a 


x? = 39, p >.50. 


the mean ages of those who yielded (22.3) 
and those who did not (20.6). ; 

For this group of subjects production of D 
themes was relatively infrequent, the range 
being zero to three. Fifteen of the 27 subjects 
Wrote at least one D theme and the median 
value for the group was one. Twenty-one k 
the 27 subjects produced one or more 
themes with a range of one to five and a 
median of one for the entire group. 

In tar ta test the relationship between 
dependency themes and conformity with group 
Opinion, the 27 subjects were divided pe 
8roups of “yielders” (those who etal a 
€ast once) and “nonyielders.” The distri i 
tions of D and d scores were dichotomize 
into high (above median) and low (median 
and below) groups. 

Tables ae 2 show the frequency of the 
number of yielders and nonyielders among 

Ose with high and low D and d gis 
"espectively. The values obtained when c 
quare tests, using Yates’s correction, are ap 

led to these data are also given. 


Discussion 


The results indicate that conformity : 
koup opinion can be predicted from cer : 


kinds of dependency themes on the 


Table 1 shows that every one of the 10 sub- 
jects who produced two or more D themes 
yielded to the incorrect majority opinion. 

On the other hand, the more indirect meas- 
ure of dependency, d themes, was not sensi- 
tive in predicting group conformity. Appar- 
ently individuals who see their heroes as ac- 
tively seeking aid are more likely to behave 
dependently (as defined here) than those in- 
dividuals who portray their heroes receiving 
unsolicited nurturance. 

In addition to the need for support in mak- 
ing decisions, fear of loneliness and isolation 
might characterize the dependent individual. 
Thus, fear of alienation by the group for dis- 
agreeing with the majority judgment may 
have motivated conformity with the incorrect 
group opinion. Minimal support for this no- 
tion is found in the TAT themes in response 
to the picture of the boy sitting alone on the 
door step of a log cabin (Card 13B). Al- 
though themes of loneliness were infrequent 
for these subjects, four of the five individuals 
who described the boy as lonely, yielded to 
the majority opinion. 

The unique qualities of the conformity 
situation suggest the need for caution in gen- 
eralizing the implications of these findings. 
Although the subjects who wrote several D 
themes conformed in a pressure situation with 
same sex peers, these men might react differ- 
ently with individuals of different (‘Sex or 
status, e.g, younger women, authority fig- 
ures, lower class individuals, etc. BE 

Moreover, the pressures to conform in this 
situation were apparently very strong, for all 
subjects, yielders and nonyielders, appeared 
uncomfortable when their judgm enis 
reed with the incorrect majority. Those 


who yielded in this laboratory situation, 
therefore, might not conform in social con- 


texts characterized by considerably less group 
pressure. 


Summary 


f this study was to relate de- 


The purpose 0 os 


pendency themes on the TAT to the ten 
nform to group opinion. 
oyna male undergraduates wrote 
stories to eight TAT cards and then were in- 
dividually observed in the Asch conformity 
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situation. In this situation, the subject and 
four other male students were requested to 
discriminate lengths of lines and orally an- 
nounce their judgments. Unknown to the ex- 
perimental subject, the other four men were 
cooperating with the experimenter and on 
prearranged discrimination trials, announced 
incorrect answers in an attempt to pressure 
the naive subject to conform with the incor- 
rect majority judgment. 

The subjects who produced TAT themes in 
which the hero sought help in a problem 
situation or was portrayed as disturbed over 
loss of sources of love and support yielded to 
the incorrect majority more frequently than 
those subjects not writing these types of 
stories (p < .01). 
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Cross Validation of Objective TAT Scoring’ 


Richard H. Dana 
St. Louis State Hospital 


PS TAT scorirs catégories have only 
categorie een introduced (2, 6). Three of five 
or | eee originally proposed as significant 
SPAR Co en differentiation successfully dis- 
groups (2 etween normal and abnormal male 
these oe As prediction measures two of 
Perceptu om Perceptual Organization and 
Cent of al Range, identified 76 and 70 per 
Totics de 60 and 64 per cent of neu- 
respecti K 78 and 84 per cent of psychotics, 
ceptual D y in the experimental groups. Per- 
lated 90 ersonalization prediction scores 150- 
figures 4 per cent of the normal group. These 
Totic <a the result of use of normal-neu- 
teria, neurotic-psychotic medians as C1- 
tee application of these three scoring 
va daton to other populations, 1€», cross 
increasing? and the accessibility of results on 

er q ingly larger groups is a necessary fur- 

evelopment. 


Scoring System 

Perceptual Or- 
Range (PR), 
ere se- 


wes scoring categories, 
Perceptia (PO), Perceptual 
ected — Personalization (PP), W 
80ries rom the five original scorms cate- 
inks the basis of their prediction scores. 
ts a tual Organization. The category re- 
Irectj e S’s ability to follow the standard 
u TS to “tell a story.” Components 1n- 
Bast on ee description, present behavior, 
F vents, future events, feeling, thought, 
Miner One point is scored for each 
aon used in the story- ; 
ope, e ptual Range. Three separate stimulus 
tties were selected for each card on the 


Alec 


ection with an 


igation supported by a research grant from 
h, of the Na- 


tiong “Tonal Institute of Mental Healt 2 
Nstitutes of Health, Public Health Service. 


up 
: his 
Vestin, Study was carried out in conn 


basis of utilization by at least. 90 per cent of 
a “normal” group (7). PR is designed to sam- 
ple the extent to which the usual or “popu- 
lar” appears in the story. A list of the 15 
stimulus properties follows: Card II (a) 
family: young girl; woman, activity specified; 
adult male; (b) fields or farm; (c) books or 
school; Card III (d) figure, sex and age 
specified; (e) emotions noted; (f) activity 
specified ; Card IV (g) man, emotions noted, 
activity specified; (h) woman, activity speci- 
fied; (i) conflict or cooperation; Card VI 
(j) man, emotions noted, activity specified; 
(k) woman, emotions noted; (/) personality 
referent; Card VII (m) older male, activity 
specified, relationship specified; (7) male, 
emotions noted; (0) personality referent. 
One point is scored for each of these men- 
tioned in the TAT story. All items included 
in each point must be mentioned for score to 


be earned. 
Perceptua 

sions, words, 

are incongruous a 


1 Personalization. Some expres- 
and phrases used in the story 
nd have no obvious refer- 
ence to the story that S is trying to relate. 
These inclusions are clearly neither stimulus 
reproductions nor additions to the stimulus. 


PP are deviations from the relatively con- 
sistent, organized, coherent protocol-product, 
hese deviations, in order to 


the TAT story. T 
be extreme. They may refer 


be scored, must 
to things labeled performance adequacy, com- 


ments, parenthetical remarks, qualifications, 
picture criticisms, adventitious descriptions, 
vagueness, evasion, or direct personal refer- 
ence. One point is scored for each personal- 


ized inclusion. 
Problem 


dation is an attempt to ascertain 


Cross vali 
se selected TAT scores will func- 


how well the 
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tion when applied to different samples of Ss. 
If these TAT sceres are to be usable on groups 
other than those on which they were devel- 
oped, they should be significantly related to 
clinical diagnosis on cross-validation samples. 
Furthermore, all three scoring categories 
should significantly differentiate between nor- 
mal and clinical groups. 

Subjects. The TAT stories resultant from 
administration of cards 2, 3BM, 4, 6BM, 
7BM (5) were collected from three groups 
of male Ss: normals, neurotics, psychotics, 
30 in each group. The Ss were chosen in 
terms of the same criteria as in the original 
study with one difference: the neurotic Ss 
were not hospitalized but were outpatient 
clinic patients. 

Procedure. The 450 stories obtained from 
the three groups were scored for each of the 
three categories. The five stories from each 
S were treated as a unit. These units were 
coded, randomized, and scoring was done fol- 
lowing mimeographed directions on a spe- 


cially prepared score sheet by the author 
and a clerk.? 


Results 


Reliability. Two kinds of scorer reliability 
were computed by means of percentage of 
agreement: (a) Scoring category reliability; 
(b) reliability of the items composing the 
categories. The appropriateness of percentage 

ing projective test 
scussed previously 
others (8). 
Scoring category reliability was determined 
from the results of two scorers on 75 stories, 
25 from each group, chosen at random, and 
scored in random order to avoid knowledge 
of the group to which any particular record 
belonged. The reliabilities of PO, PR, and PP 
were 93, 90, and 75 per cent of agreement, 
respectively. The over-all reliability of these 


? Mimeographed copies of the TAT scoring direc- 
tions and the score sheet may be obtained from the 
author upon request, or from the American Docu- 
mentation Institute. To obtain them from the latter 
source, order Document No. 4743 from ADI Aux- 
iliary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 
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three scoring categories was 89 per cent. 
These figures are somewhat higher than those 
reported in the original study. These differ- 
ences can be attributed to: (@) practice in 
scoring obtained by both scorers; (b) the 
formalization of scoring criteria on a com- 
pact, easily used score sheet. 

The reliability of scoring separate PO and 
PR items ranged from 80 to 100 per cent of 
agreement. The percentages of agreement for 
PP were 81, 73, 74, for normals, neurotics, 
and psychotics, respectively. 

Validity. Validity, with diagnosis as the ex- 
ternal criterion, was obtained by use of a non- 
parametric median test. Table 1 presents the 
median and range for each of the three 
groups on each scoring category. The scores 
in each category were placed in rank order 
and combined medians obtained for the 
groups being compared: normals-neurotics; 
normals-psychotics, neurotics-psychotics. The 
number of cases falling above and below these 
combined medians was determined by inter- 
polation. Chi square was then used to deter- 
mine differences between groups (Table — 

The median test results indicate: (a) po 
and PR significantly differentiate between NOT 
mal, neurotic, and psychotic groups. (b) P. 
significantly differentiates between normal ane 
clinical groups, but does not distinguish a 
tween clinical groups. Thus, cross validar? i 
of PP does not substantiate the significa” 


Table 1 


Median and Range for Normal, Neurotic, and Psychol 
Ss on Perceptual Organization (PO), Percep- 
tual Range (PR), and Perceptual 
Personalization (PP) 


Category Median Range 
PO 

Normal 26.50 22-31 

Neurotic 18.50 11-24 

Psychotic 10.78 6-21 
PR 

Normal 13.38 11-15 

Neurotic 8.78 5-11 

Psychotic 5.17 1-9 
PP 

Normal 29 0-6 

Neurotic 3.83 0-29 

Psychotic 5.00 0-40 


ee 


EE EEE Ee 
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Table 2 


Summary of Median Test Results on PO; PR;;PP 
Scores of Three Groups 


Combined Above 

Category median median x? $ 
PO 

Neca 2300 2O s23 <.001 

el 2150 509 sso <.001 
m ered 1400 780 45.1 <.001 

ieee mor P$ sso <.001 

Sa 950 300 s61 <.001 
m Poek 7o %99 397 <.001 

i 

Nett 19s $2 m6 <o 

No 

sich 2.60 n 30.4 <.001 

sychotic 4.33 18.0 6 = 


sn EO O 
pierentiation obtained between neurotic and 
ychotic groups in the original study- 
em i approximate prediction measure was 
ines Oed to determine the extent to which 
ce Shali are identified correctly by each of 
Ported «ens categories. The two medians re 
Catego 1n the original study for each scoring 
otic "y were used as criteria: Lge 
Score and neurotic-psychotic. The me ian 
Pp > Used for PO were 24.50 and 16.94; 
ives eg were 11.19 and 7.68; and i 
Nor S Were 1.90 and 7.37. Scores below the 
l-neurotic median were given 0; scores 


falli i $ 
ane between the normal-neurotic median 
; © neurotic- ic median were given 
1 ic-psychotic ot 


me ia Scores above the neurotic-psych 
an Were given 2. l 
mies shows the results for each scorns 
mbined in 
each WS Ways to provide the discrimination of 
0, l Scoring category with each cutoff po n 
Sclectin Maximum discrimination is oo 
the ra a cutoff score which ay i 
Maing erences between groups. Thus, he 
ing c> the “best,” ie., maximally discrimina 
category on which 98 per cent of norm 


Cate 
Bory. These figures may be co 


Ss had 0, 81 per cent of neurotic Ss had 1, 
and 84 per cent of psychotic Ss had 2 scores. 

Comparison of these prediction scores with 
those obtained in the original study (2) indi- 
cates that both PO and PR retain their ef- 
fectiveness on new populations. In fact, the 
prediction level for the cross-validation groups 
is somewhat higher than in the original 
groups. The level of prediction for PP is sub- 
stantially equivalent to that originally ob- 
tained. PP remains effective for distinguish- 
ing normal from pathological groups but not 
for more precise differentiation of degree of 
illness. 

Cutoff scores were also determined in the 
same manner from the data of this cross- 
validation sample using the medians reported 
in Table 2. Prediction levels were enhanced 
by this method. For scoring category PO, 97 
per cent of normal Ss had 0, 90 per cent of 
neurotic Ss had 1, and 93 per cent of psy- 
chotic Ss had 2 scores. For PR, 100 per cent 
of normal Ss had 0, 96 per cent of neurotic 
Ss had 1, and 93 per cent of psychotic Ss 
had 2 scores. PP prediction scores were not 


appreciably different from those obtained 

using cutoff scores derived from the original 
E 

study. 


It is suggested that cross-validation differ- 
ences may result from the use of an outpa- 
tient neurotic group which exaggerated the 
differences between groups by provis in. a 
more nearly equidistant on a hypothetical 


Table 3 


ach Group Receiving Scores of 


g in E 
Percenmge oia “2 on Each Category 
Category 
EEE 
Group PO PR BE 
Normal 98 72 
80 

U 20 2 28 

3 0 0 0 
Neurotic i 2 10 
: 66 81 64 

; 33 17 26 
ae ‘ 0 6 
1 6 16 57 

2 94 84 37 
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continuum of “illness” between the normal 
and psychotic gioups. This suggestion is given 
credence by the almost complete absence of 
overlap between the normal and psychotic 
groups in the original study. To a consider- 
ably lesser degree, the additional training and 
experience of scorers reflected in the higher 
reliability figures may have been operative in 
sharpening differences between groups. The 
fact remains that there was minimal overlap 
between the three groups for PO and PR 
scores. 


Discussion 


The use of objective TAT Scores for male 
groups seems to have considerable diagnostic 
power. This success may be attributable, at 
least in part, to test scoring based on a 
rationale for simple, consistent, theoretically 
derived objective scores for all projective 
tests (3). This rationale is based on three 
aspects of test behavior deemed sufficient for 
development of objective scoring systems: (a) 
approach to the 


specified percentages of “normal” 
Tarity of response (those j 
in a “normal” with 
in psycho- 
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theoretical assumptions concerning person- 
ality, i.e., Personality Orientation (1), ante- 
date the rationale from which these scores 
were developéd. However, the use of these 
categories demands no particular theoretical 
approach to personality. Similarly, the de- 
velopment of objective TAT scores does not 
imply abandonment of content analysis but 
is merely a formal aid to this process. : 

However, objective TAT scoring to attain 
more than mere passive clinical recognition 
must yield descriptive personality data. Fur- 
ther research must concentrate upon this as- 
pect of validity. 


a 
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or E berimental investigations of role taking 
the empathic process have been primarily 
eteted with “normal” Ss, especially col- 
aA students. THe results of these investiga- 
1S, notably the studies of Dymond (3, 4, 
and McClelland (8), suggest that the 
ib the degree of emotional instability, 
© Poorer the ability of the Ss to take the 


4 . . = 
ole of another. These findings are consistent 


With the hypotheses offered by Cameron (1, 
ee Suggested that a disturbance in role- 
schi 8 skills is crucial to the development of 
zophrenia, 
Pri Present experiment was designed to 
Dhre re role-taking characteristics in schizo- 
lizie oe In addition, it was hoped that some 
Would be cast upon the characteristics 
eo ability, not only in schizophrenia, 
or the normal individual. Specifically, two 
Jor hypotheses were tested: 
Dsy; ,Schizophrenics, when compared with non- 
ski rhotic individuals, show poorer role-taking 
ills, 9 


nea onpsyechotic individuals, when com- 

to schizophrenics, are more homoge- 
“us in their agreement with one another as 
the characteristics of the individual whose 


0 
ês they are instructed to take. 


Da 
Ne 


Procedure 


Studies in role taking have used what might 


termed the method of personal acquaint- 
1 
a dee Present paper is 
le coal dissertation completed 
Drese olumbia University. The author V E is 
„his indebtedness to the chairman of his as 
to aon committee, Professor E. J. Shoben, Jr an 
‘heir a L. F. Shaffer and Herbert Solomon tor 
2, SUidance and assistance. 7 
md at Park Lane Neuropsychiatric Clinic, 
n . 


a condensation of & part of 
at Teachers Col- 
vishes to ex- 


Clever, 
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anceship. Students sharing a common course 
in college are asked to rate one another. In 
a study which seeks to compare schizophrenics 
and normal individuals, such a procedure be- 
comes impractical. It is especially so when it 
is desired that the degree of familiarity as 
well as the type of relationship be controlled. 

In the present study, therefore, an auto- 
biography obtained from a former hospital 
patient was used as a common stimulus. The 
patient had been hospitalized briefly for one 
of a series of minor recurring depressions. He 
was frank, honest, and, in the opinion of the 
hospital staff, someone with whom one could 
readily empathize. He was asked to discuss 
his life with reference to parents, siblings, 
courtship, marriage, sex, education, and vo- 
cation. From this material, an 80 item Q sort 
was constructed. Items were selected which 
minimized reactions on the basis of fact; 
rather, they emphasized the need for infer- 
ence on the part of the S. This procedure also 
reduced the likelihood of the sort’s being a 

ding task. 

"as sort was then administered to the 


hor of the autobiography with instructions 
items so as to reflect most 


Jings and attitudes. The re- 
hereafter as the Criterion 


aut 
to distribute the 


accurately his fee 
sult is referred to 


t. 
h of the Ss was asked to take the Q 


sort twice: First, they sorted the items to 
reflect their own attitudes and feelings. The 
second time, they were read the autobiog- 
raphy. They also had a copy which~ they 
could read and refer to. They were then asked 
to take the Q sort again, but this time as it 
reflected the ideas of the author of the auto- 
biography. They were to act like him when 
they took the test. The present paper is con- 
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Table 1 
i Summary of Background Data 
Qs P’s T.B Normal F Ratio 

in y 35.9 38.2 37.9 33.4 99 
Age in years 2 Eoun 
School grade completed 10.6 11.5 10.1 2 3.61 
Reading grade level 8+ 8+ 8+ 84 E 
Reading score 14.9 17.4 18.5 19.6 e 
Vocabulary raw score 23.2 26.5 23.6 25.1 aa 
Hospitalization months 43.9 37.2 37.8 5 


t The F ratios are the results of the analyses of variance on each of the five factors indicated. 


* Significant at the .05 level of confidence (Fo; = 2.76). 
* Significant at the .01 level of confidence (Fo; = 4.13). 


cerned with this second or Simulated sort and 
its relationship to the Criterion. 


Subjects 


All 64 Ss were given screening tests consist- 
ing of the Wechsler-Bellevue Vocabulary Test 
(12) as an estimate of verbal abilities and a 
reading test (10). The aim here was to elimi- 
nate illiterates, functional mental defectives, 
and those too uncooperative or inattentive to 
manage the tasks adequately. 

Of the 200 male schizophrenic patients at a 
chronic treatment center between the ages of 
20-45 who had been hospitalized for two to 
five years, 25 remained after screening. These 
25 patients fell into two groups, a chronic 
group of 15 patients, and a privileged group 
of 10 patients. Chronic patients are confined 
to the wards and have a poor prognosis. Their 
activities are limited to simple routine ward 
chores. Privileged patients have made a suffi- 
cient recovery to be permitted freedom of the 
grounds. They worked in the hospital shops 
and some were being considered for discharge. 

A group of 19 tuberculous patients were in- 
cluded as a control for any possible deteriora- 
tion due to hospitalization. They were non- 
psychotic and had never required consulta- 
tion for a mental disorder. They had been 
hospitalized for a period ranging from twenty 
months to five years. 

The normal group included 20 individuals 
who were functioning members of their com- 
munity. None had been hospitalized for a 
mental disorder or had ever sought profes- 
sional help for such a disturbance. They were 
firemen, machine operators, clerks and the 
like. All were gainfully employed. 


Table 1 provides a summary of the back- 
ground data of the subjects employed. A? 
analysis of variance indicated that the groups 
differed significantly on two factors: parri 
tion (at the .05 level of confidence) and rea 
ing ability (at the .01 level of confidence): 
Chronic schizophrenics and tuberculous P# 
tients appear to be less well educated i 
the other two groups. While all groups Wet 
able to surpass requirements for an eig ng 
grade reading level, chronic schizophren i 
show a marked impairment in these ski! x 
possibly as a function of a concentrati“ 
difficulty. Age, length of hospitalization, “A 
verbal abilities do not differ significa? 
among the groups. ing 

The hitene. of education and readin? 


as > pe 
ability was considered in the analysis oft 
results. 


Results 


normally distributed. The resulting array w 
subjected to an analysis of variance. ie 
ratio obtained (F = 11.05) indicates that e 
between group variance was greater than 

within group variance to a degree in excess 


= 


e 
that which might be anticipated by cham | 


( = 4.13). The analysis was continue e 
ing a ż test, the results of which can be 5° 
in Table 2. + nif 
As can be seen, all groups differ sig” 
cantly from the chronic schizophrenic ar d 
in their ability to empathize. The privileé ei 
schizophrenic group is superior to all otb 
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Table 2 


Mean Empathy Scores of All Groups and the 
Significance of the Differences 
Between Means 


C’s P's TE. Normal 
Mean .050 437 356 290 
SD 236 165 149 153 
C'st 4.61% = 4.25" 3.33%" 
Pst 1.2 2.22" 
Normal 13 


f Significance at or better than the .05 level of confidence. 
ignificance at or better than the .01 level of confidence. 


This superiority is particularly striking when 
the privileged patients are compared with nor- 
Mal individuals. Tuberculous patients, while 
Significantly different from the chronic schizo- 
Phrenics, stand between the privileged and 
normal groups and are significantly different 
from neither, 

To determine whether these results were in- 
fluenced either by reading ability or educa- 
tion, an analysis of these two factors was 
carried out using the Mann-Whitney U test. 
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The entire group was split in two, a high and 
low empathic group. A comparison was then 
made between poorer readers and more pro- 
ficient readers. A similar analysis was made 
comparing education. A critical ratio of .49 
for reading ability and .36 for education sug- 
gested that these factors had little bearing on 
empathic ability. 

The second hypothesis was tested by cor- 
relating the Simulated sort of each individual 
with the sort of every other individual in his 
group. The distribution of correlations and 
their medians can be seen in Table 3. 

From this array, it would appear, inspec- 
tionally, that the differences between the 
chronic schizophrenics and other three cate- 
gories are particularly pronounced. Normals, 
it would appear, are superior to all groups, 
and, as was the case with role-taking meas- 
ures, privileged schizophrenics most closely 
resemble tuberculous patients. The tubercu- 
lous appear to have greater homogeneity than 
the psychotics. Consequently, there seems to 
be an increasing degree of homogeneity in 


Table 3 


Distribution of Intragroup Scores 
P’ Normal 
C's s 
N o7 N % 
Scores N % N % N To 
—.30 1 1 
—.25 3 4 
=.20 8 f 
=15 6 17 1 2 , 
Tios Ao 1 6 1 ; 
—05 10 30 1 : 
0 34  63* 3 5 2 : s ; 
05 19 80 L oy : F HEr 
15 : 8 3 17 19 w g 
20 _ 4 42 17 29 t p 
.20 4 97 t & 9 45 EE 
20 i !? g 2 18 4 
35 i 2 6 10 59 a 
10 7 8 16 68 2 7 
a5 3 Ot 14 77 > 4 
50 1 93 15 86 - 
2 96 1 %2 
: 95 12 97 
55 1 
5 á 2 9% 3 9 
f 4 9 1 
-70 i l 
.75 i 
-80 


* 
Median rank for each group has been italicized. 
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going from the chronic schizophrenics through 
the privileged and tuberculous Ss to the 
normals. 

The fact that each individual was corre- 
lated with everyone else within his group 
makes for a lack of independence in observa- 
tion that precludes the application of a sta- 
tistical analysis or any conclusive tests of 
homogeneity among the groups. While, there- 
fore, it appears that normal individuals are 
more homogeneous in their agreements and 
that schizophrenics agree less among them- 
selves concerning the individual whose roles 
they take, this conclusion must be taken only 
as suggestive in view of the inapplicability 
of rigorous tests of significance. 


Discussion 


The findings tend to confirm certain aspects 
of the hypotheses. Others remain moot and 
unsupported. The normal individual’s reac- 
tion appears to be more consistent with the 
hypothesis offered by Lindgren and Robinson 
(7). Rather than responding with any marked 
degree of sensitivity, normals appear to re- 
spond more in terms of a preconceived and 
more universally shared idea of what another 
should be like. It seems likely that “well-ad- 
justed” individuals of Dymond’s studies had 
a good appreciation of cultural norms and ex- 
pectancies from which their judgments were 


: c phrenic is apparently de- 
ficient in both areas. He is indeed the indi- 


vidual, responding on the basis of his own 
fantasies and ideas, with little concern for 
either the accuracy of what he perceives or 
whether his ideas are shared with others. One 
limitation of this study is the lack of cer- 
tainty as to whether the chronic schizophrenic 
patient responded because of a basic impair- 
ment of role-taking skills or because of dis- 
interest in the task. It was hoped that this 
latter was minimized by screening. F ollowing 
an analysis of the results, the question ap- 
peared to remain unanswered. Because of 
practical considerations due to the lapse of 
time, the reliability of the sorts could not be 
obtained. 
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Some suggestion that role taking may ni 
be deficient in the chronic schizophrenic, bt 
merely not utilized, is offered by the resul 
of the privileged patients. Assuming that th 
latter were once as severely disturbed (re 
quiring custodial treatment) as were th 
chronic schizophrenics, partial remission fror 
the disease appears to be characterized by | 
hypersensitivity to the feelings of others, ! 
phenomenon Fromm-Reichman aptly title’ 
“emotional eavesdropping” (6). In contras 
to normal individuals, however, they appe@ 
to lack a conventional frame of reference 
Despite their relative accuracy in role tak 
ing, each responded to the cues given in 4 
very individual manner. 3 

The results pose at least two problems: 
What is it that permits, or enables the schizo 
phrenic to respond with such sensitivity 
Secondly, why do they respond with suc 
sensitivity? s 

In reviewing the method, the task appear? 
to be not unlike a projective or semistruc 
tured situation. An Opportunity was provide 
for interpretation rather than a repetition 2 
facts, as so much of the behavior of a e 
might be characterized as projective 1n ‘of 
psychometric sense of the term. The a 
of the normal individual was to projec , 
Preconceived set of ideas based primarily ie 
a commonly shared cultural stereotype: me 
Privileged patients, responding to the $3 4 
information, made better use of it, alman 
their reactions were highly idiosyncratic. >“ 
bin’s description of the schizophrenic m5 
lacking a “generalized other” concept s e 
appropriate to the results here ati, kh 
schizophrenic, possibly because of this ra 
responded to the cues as he perceived t nds 

he normal individual, on the other ha? 
may have received the same cues, teste ot 
evaluated them, and, in the absence of oY 
toborating data, rejected many of the pe 
potheses. The Schizophrenic appears er) 
much less critical. In all probabilities, r 
this lack of criticalness and a lack of 4 fell 
ventional frame of reference, or what a 
has termed a “generalized other” (9), 5¢ | 
to contribute to the hyperacuity noted. bi 

Assuming that schizophrenics lack ‘p 
generalized other, such an impairment, } jp 
resultant hyperacuity, should be fou 
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younger children, and in emotionally dis- 
turbed children as compared to well-adjusted 
children of the same age. Since such concepts 
asa generalized other are predicated on the 
transition from concern with particular peo- 
ple, via interpersonal relationships, disturb- 
ances in such relationships, as is indicated in 
‘chizophrenia, would contribute to a failure 
.° make the transition. If inconsistency, re- 
Jection, and hostility characterize the history 
Of the individual with a predisposition to the 
op elopment of schizophrenia, he would look 
h si individual not unlike a sentry on a 
e frontier, carefully evaluating and ap- 
ane each one, and never, as do normal 
tel Widuals, taking others for granted, and 
ying on generalized norms of what others 
are like, 
in Concerning the tuberculous group, the find- 
fo only equivocal suggestions. In terms 
clos “We results, these Ss appear to most 
Wett, resemble the privileged schizophrenic. 
dd ner this is a function of the debilitating 
and the sequences of long ange ene 
“ihn of the dais ted = 
Search a. personality, awaits aed 
Would. t is interesting to note tha 5 
han expect a higher degree of homogenc! y 
als appeared to characterize these individu- 
on, Since they are sequestered together for a 
ont Period of time, and have an excellent op- 
unity to know one another. 


Summary and Conclusions 


at cizophrenics, tuberculous, nonpsychotic 
on a and normal individuals were tes e 
et er ability to take roles. Empathy mes 
ee o ied by their ability to simulate the 
io, Performance of an author of an psie: 
ey which was provided them. In m 
Oth A the relative agreement with one k 
resul Within each group, was determmec- 

1 ts suggest the following: spia 
tole-t hronic schizophrenics fave impa 
in aking skills and are relatively ind? 

elr perception. 
Ormal individuals, 
e schizophrenics in role-ta 
More inclined to rely on a con 


while superior to 
king skills, 


Chronic 
i ventional 


frame of reference, rather than demonstrating 
marked role-taking skills. © 

3. Privileged patients show a marked sensi- 
tivity to others, but appear to respond in a 
highly idiosyncratic manner. 

4. A suggestion was offered that schizo- 
phrenics appear to lack a concept of a “gen- 
eralized other,” and that they never make 
the transition in role-taking skills, from em- 
pathy with particular people to a more con- 
ventional—universally shared—frame of ref- 
erence. 

5. Tuberculous patients appear to be more 
like the privileged or partially remitted schizo- 
phrenics. The findings here, however, can only 
be suggestive in the absence of statistical sig- 
nificance. 

6. The autobiography appears to be a use- 
ful tool in the measurement of empathic 


ability. 
Received June 6, 1955. 
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Some Psychological Correlates of Humor Preferences’ 


Rudolf Grziwok 


The University 


of California 


and Alvin Scodel 


The Ohio Stat 


One hundred and forty male college stu- 
dents were given the following sequence of 
procedures: (a) A series of 40 cartoons on 
which ratings of funniness were made; (b) 
The TAT (Cards 4, 6BM, 7BM, 13MF, 14, 
18BM, 16); (c) The Allport-Vernon-Lindzey 
Study of Values. 

The 40 cartoons were selected from a larger 
group of 250, all of which had originally ap- 
peared in The New Yorker magazine. Three 
judges placed each cartoon into one of five 
categories defined as follows: 1. Humorous ef- 
fect based on aggression, either explicit or 
deliberately understated; 2. Humorous effect 
obtained by a parody on sex; 3. Humor based 
on the exaggeration or paradoxical use of so- 
cial stereotypes; 4. Humorous effect based on 
obvious and striking logical incongruity; 5. 
No category was applicable or two or more 
categories were equally applicable. 

The first two categories (aggression and 
sex) can be subsumed under “orectic humor” 
and three and four (social commentary humor 
and humor based on logical incongruity) un- 
der “cognitive humor.” 

Seventy-three cartoons, excluding agree- 
ments on category 5, were placed in the same 
category by all three judges, a degree of 
agreement exceeding chance at the .001 level. 
The final series of 40 cartoons contained 10 


1 An extended report of this study may be ob- 
tained without charge from Alvin Scodel, Psychology 
Department, The Ohio State University, Columbus 
10, Ohio, or for a fee from the American Documenta- 
tion Institute. Order Document No. 4742 from ADI 
Auxiliary Publications Project, Photoduplication Serv- 
ice, Library of Congress, Washington 25, D. C., re- 
mitting in advance $1.75 for microfilm or $2.50 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 
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cartoons from each of the first four cate- 
gories. No cartoonist was represented in any 
category more than twice, and duplication of 
themes was avoided as much as possible. 
The TAT stories were scored according t° 
specially constructed scales for degrees of ag- 
gressive and sexual content and, in oe 
tion, intraception vs. extraception. Indepen® 
ent scoring by the writers of a portion of the 
Stories resulted in agreements of 90%, 9291 
and 88% respectively; in view of this hig 
agreement, remaining scores were scored bY 
the senior writer. f 
In the evaluation of results the ratings ° 
funniness were converted to standard seort 
and then ranked. The TAT and Allport 
Vernon-Lindzey scores were dichotomized a" 5 
then compared on the basis of humor scO¥@ 
by the use of the Mann-Whitney test. Be 
The significant results indicated that ne 
jects high in TAT aggression prefer aggre?” 
sive humor while those low in TAT aggres 
sion prefer social commentary humor. wi n 
respect to value orientations subjects high i 
the aesthetic scale prefer logically incongrue 
cartoons whereas those who are low on -i 
Same scale prefer aggressive humor. Mo" r 
over, subjects high on the social scale prefe! 
aggressive cartoons and those low in the maen 
retical value show a preference for Sen 
cartoons. In more general terms a preferenca 
for orectic humor, as opposed to cognitiv 
humor, seems to be characterized by mo 
fantasy aggression, more extraversion or O" 
goingness, less preoccupation with intellectu? 
values, and less psychological subtlety or ail 
plexity. 
Brief Report. 
Received October 10, 1955. 
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Pi saline: worker interested in problems 
e “one VERA CKOTLIS faced with a dilemma. 
Plex E he is concerned with are com- 
simplify ¢{} he chooses in his research to 
minimize he variables he employs, so as to 
urement problems involving issues of meas- 
Scure the the assumptions he must make ob- 
concept e relationship of his variables to the 
e oe a theories he started from. If, on 
ables dir and, he prefers to work with vari- 
milati wo relevant to his theoretical for- 
in the ao he must face a multitude of issues 
logical t urse of developing adequate methodo- 
hi ools (2), 
Patticul ans has come to our attention 
Pretation in our studies of depth of inter- 
rectly i This complex variable derives di- 
as i. psychoanalytic theory (6) and 
t erapeutie subject of disagreement among 
© Step tow ic theories (3, 5). As a necessary 
viewpoine testing the differing theoretical 
ave de S about depth of interpretation, we 
sing ¢ veloped a measure for the concept, 
tee oe methods for constructing 
Such ag. scale (8). However, a rating scale 
in oth, = have used and such as is common 
respond. clinical studies, forces judges to 
Sing] as though they were dealing with a 
© dimension, irrespective © the true 


1 Th; 

by bb Paper is part of an investigation supported 

Instit research grant M-516 C-2 from the National 

of pote of Mental Health of the National Institutes 
Service. 
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= A Dimensional Analysis of Depth of Interpretation’ 


H. L. Raush, Z. Sperber, D. Rigler, J. Williams, N. I. Harway,’ 
E. S. Bordin, A. T. Dittmann,” and W. L. Hays 


University of Michigan 


complexity of the variable. Therefore, the 
dimensionality of depth of interpretation re- 
mains to be studied. 

We shall describe four studies designed to 
determine: (a) whether depth of interpreta- 
tion is uni- or multidimensional; (b) whether 
the dimension or dimensions revealed are con- 
sistent with our concept of depth of inter- 
pretation; (c) to what extent other dimen- 
sions can be identified. 

If we demonstrate that depth of interpreta- 
tion is in fact unidimensional, we can proceed 
scale and to make more confident 
ts relationship to other varia- 
bles. However, interjudge reliabilities ob- 
tained for rating of single therapist responses 
were low enough to raise questions about the 
likelihood of finding unidimensionality. If we 
uncover evidence of more than one dimension, 
but we judge that these dimensions can be 
incorporated into a revised notion about depth 
of interpretation, then our study will have 
brought about a modification in our concept 
or theory. Also, by being able to identify 
these dimensions we may be able to achieve 
better agreement among raters. Finally, if 
more than one dimension 1S revealed, any of 
the additional ones may prove irrelevant from 
our point of view and might be susceptible to 
elimination through refinement of the scale 
or through training of judges. 

In summary, our specific purpose in this 
paper is to find out what attributes judges use 
in dealing with depth of interpretation, to 
what extent they agree as to the attributes, 
and to what extent any of these attributes 
corresponds to our definition and scale of 
depth of interpretation. The approach we 
shall discuss is applicable to a wide variety 


to use the 
inferences about i 
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of clinical studies. It accepts the complexity 
of psychological phenomena; it places rela- 
tively little constraint on the data; and it 
allows us to estimate the number and to de- 
scribe some characteristics of dimensions that 
judges are actually using in evaluating com- 
plex attributes. 


General Method 


Definition. Depth of interpretation was de- 
fined for the judges as follows: “any behavior 
on the part of the therapist that is an expres- 
sion of his view of the patient’s emotions and 
motivations—either wholly or in part—is con- 
sidered an interpretation. A patient has vary- 
ing degrees of awareness of his emotions and 
motivations. Depth of interpretation is a de- 
scription of the relationship between the view 
expressed by the therapist and the patient’s 
awareness. The greater the disparity between 
the view expressed by the therapist and the 
patient’s own awareness of these emotions and 
motivations, the deeper the interpretation.” 
In most of the studies the judges were given, 
in addition to the definition, a seven point 
scale with nine descriptive statements illustra- 
tive of various points on the scale (8). 

Judges. The judges used for all studies were 
Ph.D.’s, staff psychologists, or advanced grad- 
uate students at the University of Michigan, 
all of whom had at least 100 hours of experi- 
ence as psychotherapists. 

Stimuli. All stimuli consisted of excerpts 

from transcripts of recorded therapeutic ses- 
sions. Judges were presented with three con- 
secutive patient-therapist exchanges, ending 
with a therapist’s remark. Only the final thera- 
pist response was to be judged; the preceding 
section served to provide context, Selection of 
the stimuli will be discussed with reference to 
each study. 

Technique of data collection and analysis, 
Since the methods used in this study are of 
recent origin, it seems appropriate to provide 
a brief summary of them. Bennett (1) has 
developed techniques which enable us to 
estimate the number of dimensions in data 
that are collected by methods developed by 
Coombs (4). Hays (7) has expanded the 
procedure so as to provide information on the 
ordering of the stimuli on the several dimen- 
sions. These methods enable us to investigate 
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the underlying factors entering into nal 
of behavior by providing a set of dimensions 
which best account for a given set of judg- 
ments. , E 

All possible combinations of the stimuli, 
taken three at a time, were presented. The 
task for the judge was to say which two of 
the three stimuli were most alike and yiio 
two were least alike with respect to depth o 
interpretation (Method of Similarities). In 
the first two studies where six stimuli be 
used, there were 20 such triads; in the thir | 
and fourth studies using seven stimuli, there — 
were 35 triads. These triads were presente 
in a randomized order. Using each stimulus © 
the triad in turn as the reference point, We 
can then rank the other two with respect a 
their psychological distance from this Te 
erent.* 

All possible paired comparisons are der 
in association with each reference point. he 
the judgments are transitive—that is, if t” 
judge behaves consistently in going from ele, 
to triad—the partial rank orders derived fro 
the separate triads can be combined to for 
a complete rank order, or I Scale, with A 
reference stimulus coming first in the wae 
Thus for each judge, the original judgm® 

‘ 
» 


ived 


aes A 


e 
of similarity potentially can yield one I a 
from the “point of view” of each somna r 
The total number of I Scales that can Þe u 
tained from any one judge is therefore Er 
to the number of stimuli used in the stl ue 
By means of Coombs’ Unfolding Techn 
(4), we can then determine whether e” 
Scales for each judge are compatible, tha 
whethet they could all have arisen fro™ 
single dimension. : 
Even if judges differ in their I Scales, Í 
assume that in making their comparisons a 
Operate from some segment of a larger SP ool 
in which the stimuli are located, we may Fa) 
all of the I Scales. Bennett’s techniques di 
then allow us to estimate the number ° 


f we 
they 

ce 
0: 


E 

4For example, if in judging the three Stimuli ost 
B, and D, the judge decides that A and D are Mey 
alike and B and D least alike with respect t° Sjon 
of interpretation, we would convert these decis y” 
into rankings as follows: From the “point of “pot 
of stimulus A the ranking would be ADB; oul 
the “point of view” of stimulus B the ranking Ta p 
be BAD; from the “point of view” of stimul! 


the ranking would be DAB. 
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mensions required to account for the observed 
I Scales, and Hays’ techniques (7) may be 
applied to locate and order the stimuli in this 
larger space.® 


Study 1 


The first study was divided into two parts. 
In the first part we tried to determine whether 
10 judges could judge depth of interpretation 
unidimensionally when it was defined for 
them with only the paragraph (quoted above) 
regarding interpretation and depth. In the 
second part we wanted to determine whether 
and how the judgments and dimensionality 
would be modified when the same 10 judges 
were asked to repeat the task, but this time 
were also given as a guide the graphic rating 
scale (8). 

Selection of stimuli. Six stimuli were se- 
lected, three from each interview, from two of 
a series of interviews involving different thera- 
pists and patients. Therapist responses in 
these interviews had been rated for depth of 
interpretation as part of another study (8). 

he stimuli were selected so that mean ratings 
Varied across the range of depth of interpre- 
tation, and so that the variance of the ratings 
or five out of the six therapist responses Was 
ri or below the average item variance for 

€ interview. ; 
ti Results. When judges had only the defini- 
lon available to them, 35 of the 60 possible 
moe were obtained and no judge had a 
comes set of compatible I Scales. Since a 
Omplete I Scale can be recovered from the 
ata only when the judge’s comparisons are 
transitive, and since the comparisons will be 
transitive and his I Scales compatible only 
When he treats the concept in a unidimen- 
ŝtona] manner, it is evident that no judge 
handled the concept of depth of interpreta- 
= unidimensionally. At least three aes 
ree were necessary to account for the 35 0 3 
ained I Scales, but because of the limite 
amount of data and the evident confusion of 
the judges, we could not order the stimuli on 

ese dimensions. 


Where both the definition and the graphic 


we outline of the method and a step- by eA 

h: “stration of the procedure as applied to p es 

a been prepared by Dr. Hays and will be 
ailable on request. 


rating scale were available to the judges, there 
were 53 complete I Scales out/of the possible 
60. The data of three judges now yielded 
complete and compatible sets of I Scales. In 
analyzing the pooled data, three dimensions 
again were required, indicating that despite 
the addition of pretested points on the scale 
to the careful definition of depth of interpre- 
tation, the judges did not deal with the 
excerpts as though depth of interpretation 
were a single continuum. 

The stimuli on the first dimension could be 
clearly ordered and inspection of them al- 
lowed us confidently to name the dimension 
depth of interpretation. The six excerpts could 
be ordered on the basis of the means of the 
ratings that had been obtained in the study 
referred to previously. The rank orders ar- 


rived at in these two diverse fashions corre- 


lated .89. 


Study 2 

Was it the improved frame of reference 
supplied by the graphic scale, or prior prac- 
tice on the task which led to the improved 
results on Part 2 of the study reported above? 
To investigate this, a second study was initi- 
ated using the same six excerpts and 10 new 
judges. These judges did the task only once 
using both the definition of depth of inter- 
pretation and the scale as a frame of refer- 
ence. In this study 45 out of 60 possibi I 
Scales were recovered, suggesting m the 
scale items did improve the naa re pie 
but that practice probably helpe ta Th re 
dimensions were required. The stimuli 


t and second dimensions, 
be ordered on the firs ened ioe 


The first dimension 
depth of interpretation. 


was clearly i 53 I Scales of 


terial, the 
To supply more oe 45 I Scales of Study 


n . 
y s : ed oat interpretation 
were . Ag 


d sharply as the r 
e order relatia with the ordering based 


of the previous rating data 
on, the iY The third dimension still could not 
be identifed, put the ordering of stimuli on 
the second dimension suggested either of two 
interpretations. Judges could be reacting ac- 
cording to the degree of emotionality they 
anticipated the therapist’s response would 


46 


arouse in the patient (hereafter referred to as 
emotionality) ; zor judges could be reacting to 
the degree of ambiguity of the intent of the 
therapist’s response (hereafter referred to as 
ambiguity). 


Study 3 


If the secondary factors could be specified 
more accurately and if they could be demon- 
strated to be general rather than specific to 
the six stimuli we happened to use, then 
judges could be trained to recognize and cor- 
rect for the interference of such variables 
with judgments of depth of interpretation. 
Accordingly, a third study was run. 

Here judgments were again made with re- 
spect to depth of interpretation. However, 
since we were interested primarily in clarify- 
ing the meaning of the second dimension, 
stimuli were selected so as to maximize its 
possible influence. An important proof of the 
validity of our interpretation of the second 
factor would be to find that this second factor 


now becomes the primary source of the order- 
ing of stimuli. 


Selection of stimuli, 


Three stimuli from 
those previously studied 


were included. They 


, and last stimuli on the 
second dimension. If the same ordering of 


these “marker” stimuli was not maintained in 


dimension operated, 

In addition to the three “ 
new stimuli were chosen in 
manner: from three new intervie 
ten stimuli, which on the basi: 
seemed to represent various 
emotionality and ambiguity. 
and the three “marker” 
for emotionality and amb 
staff members. The four stimuli were chosen 
on the basis of the mean rankings, so that 
ambiguity and emotionality would be inde- 
pendently distributed, and so that a range 
would be represented on both these variables, 
The project staff also ranked the final seven 
stimuli for depth of interpretation. All pos- 
sible combinations of the seven stimuli, taken 
three at a time, provided 35 triads for judg- 


ment. For each judge there were potentially 
seven I Scales, 


markers,” four 
the following 
ws we selected 
S of inspection 
degrees of both 
These ten stimuli 
stimuli were ranked 
iguity by six Project 
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Judges. Only five new judges were avail- 
able. In order to provide sufficient judgments 
about the relations among stimuli, the entire. 
series of judgments was made twice. nee 
each set of judgments on these seven - : 
the judges made similar judgments on oF - 
group of stimuli discussed in Study 4 bg n 
By this procedure we attempted to maximi 


independence between the two sets of judg-. 


ments. 


Results. Forty-five out of the 70 possible 
I Scales were obtained. Three dimensioni 
were required to account for these data. T 5 
rankings by the project staff provide criteria 
for determining whether any of these pa 
dimensions could be interpreted as abet 
ing either emotionality, ambiguity, or derr 
of interpretation, Although we expected depa 
of interpretation to show up less strongly hi 
stimuli chosen for the purpose of carrying t al 
secondary qualities, again the first dimensio 
was depth of interpretation, correlating (rho 
-93 with the pooled rankings, The ordering 0” 
the stimuli on the second and third dimer 
sions was not consistent with the criteria E 
either emotionality or ambiguity. Inspector 
of the orderings gave no clue for interpret? 
tion of these secondary dimensions. We m" $ 
conclude that the secondary dimensions a 
erating in judgments of depth of interpr® j 
tion were specific to the judges and the stim 
studied. 


Study 4 


To test the generality of the depth of en 
Pretation dimensions, the first, middle, tt 
last stimuli from the first dimension (depth e 
interpretation) of Studies 1 and 2 were a 
as “markers,” in conjunction with four 1 ip 
stimuli. These new stimuli were selecte a 
the following manner: A sample of seven Le 
taken from the three additional intervie 
used in Study 3; the stimuli were choa 
initially because they seemed to represe’ , 
the depth of interpretation dimension. T er 
Seven stimuli plus the three “markers” ie 
tanked for depth of interpretation by pe 
Staff members. The four new stimuli wake 
then selected on the basis of their mean ai 
ings varying across the range of depth a rk 
terpretation. The seven stimuli, three tt de 
ers” plus four new stimuli, provide 35 t" 


-y 
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for judgment and seven potential I Scales for 
each judge. 

Judges. The five judges of Study 3 went 
through the series of triads twice. As noted 
above, to maximize the independence of these 
Tepeated judgments, work on the stimuli of 
Study 3 intervened between the two series. 

Results. Forty-five out of the 70 possible 


-T Scales were obtained. Two dimensions were 


required to account for these data. Except 
for one of the stimuli, a single dimension would 
have been sufficient. The first dimension was 
clearly depth of interpretation and agreed 
(rho) .89 with the order of the pooled rank- 
ing data. Agreement with the order of the 


Orig} 
- iginal “markers” was perfect. 


Discussion 


The researches reported have demonstrated 
the applicability of a method of data collec- 
‘on and analysis to the study of a variable 
™ Psychotherapy—depth of interpretation. 
th We had been concerned with the possibility 

at the concept of depth of interpretation, 

€spite the importance attributed to it in 
ime thinking, might, in fact, have only 
mA utility. However in each of the four 
mai, involving a sample of stimuli from 
ther Interviews with different patients and 
et depth of interpretation was Con- 
HeT the primary dimension. Although the 
o i of analysis is not sufficiently devel- 
she to allow for the quantification of vari- 
fat the logic underlying it permits, us to 
Our a confidence that more variability i 
int ata can be attributed to the depth © 
€tpretation dimension than to any of the 
er dimensions operating. 
Inte e had also been concerned with an on 
tm reliabilities observed when we 
f a to measure the depth of intep 
full of each therapist response with a m 
ag developed rating scale (8). One poss me 
of ee of unreliability may be that t e s 

Unidin tating scale forced judges to treat 
mensional a complex aspect of interview 
eae involving several dimensions. nae 
he? despite the extremely complex nature © 
ip. oaterial rated, there does seem to be a 
The icant area of agreement between judges. 
€ high correlations between the recovered 


depth of interpretation dimensions with 
pooled ratings or rankings by judges, indicate 
that ratings may be employed despite low in- 
dividual reliabilities. That is, in using ratings 
of depth of interpretation, it may be possible 
to overcome problems of low reliability of 
single judgments on this attribute by utilizing 
average ratings of several judges. Since depth 
of interpretation, the dimension in which we 
are interested, contributes most strongly to 
the judgments, pooling judgments may maxi- 
mize its contribution and reduce the effect of 
secondary factors, specific to the ratings of 
individual judges. 

The experimental method outlines a pro- 
cedure which can be applied to the study of 
many of the complex variables discussed in 
psychotherapeutic and clinical research. The 
assumption of a single dimension, implicit in 
the construction of a rating scale, often masks 
the fact that additional factors are influencing 
a phenomenon. Lack of awareness of such 
factors often leads to experimental results 
which cannot be clearly interpreted. The type 
of research we have reported allows the ex- 
perimenter to ascertain whether his variable 
is, in fact, a unidimensional attribute, and, if 
not, under what conditions the powerful and 
convenient rating scale technique may legiti- 


mately be applied. 


Summary 


Four studies of the dimensional character- 
istics of a psychotherapeutic variable, depth 
of interpretation, were reported. Depth of in- 


terpretation was shown to be treated by judges 


not as a unitary dimension but as at least 


three dimensions: The primary cree 
consistently was depth of sag enema e 
secondary dimensions varied depen DR on 
the judges and stimuli used. The imp ications 
of these results for research with complex 


psychological variables were discussed. 
Received May 9, 1955. 
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of Social Reinforcements 
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Method 

| T assessing adjustmental aspects 
any consist ave often been unrelated to 
| sult, een personality theory. As a re- 
requently pa sampled by these methods has 
Odgepodge een analyzed according to a 
retically ee ee derived, and theo- 
fi Urrent “sj elated, adjustment indicators. 
ME adjust &n approach” methods for assess- 
4 Ponses eon reflected in Rorschach re- 
eriveq mana in point. Such empirically 
$ used to a of adjustment can seldom 
“woe tech alyze behavior evoked by as- 
ich the hniques other than those for 
Present sm were devised. The aim of the 
` Pects of bek was to deal with adjustmental 
meg cory pee from the point of view of 
mom of Bal sae oy and to develop a 
wee be ay ne within this context which 
riet, ha ik ied to behavior sampled by a 
e metho E assessment techniques. 
erives its Pel developed in the 
po ny Ancona: basis from the 
nd his Se heory of Personality of 
tuct of f ents. This theory contains 
of Een defin reedom of movement which 
Obtaji ed as, “The mean expectancy 


a Otter a 
hag ast 
as 


sulg Ming ws 

4 ea, a set D pees satisfactions as a Te- 
tio e a behaviors directed to- 
194 ly relat Te lishment of a group of func- 

is i A oe reinforcements . . . ” (2, P- 

i asp, straction a of freedom of movement 
to pie» Of an ica E the adjustmental 
ividual’s behavior in relation 


8 speci 
Ci fi, 
Cera cific : 
of maing Aerie: or social goals. Inferences 
, ovement Sees over-all freedom 
ould, of course, necessitate 


tig tin 

n & an indiyi 

ul ° al hi individual’s behavior in rela- 
be S major needs or goals. This 


don 
e by ascertaining the relative 
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frequency with which his pas i i 
rected toward these te neat ra 
success and satisfaction or failure and dis- 
satisfaction. A complete study of an indi- 
vidual’s past history of social reinforcements 
would, of course, be impossible. It is feasible. 
however, to obtain samples of his current be- 
havior and to arrive at an estimate of his 
present freedom of movement through the 
analysis of these behavior samples. The So- 
cial Reinforcement Index (SRI) of the pres- 
ent study was developed with this aim in 


| 
Rati ' 
| ating Personal Adjustment Through an Analysis 


view. 
Method 
Subjects 
The Ss of the study were 87 mothers of 


d in a longitudinal study of 
and child development at 
Institute for the Study of 
Most of the Ss were 


children enrolle 
maternal behavior 
the Fels Research 


Human Development. 
members of the middle socioeconomic class. 


Their distribution on the Index of Status 
Characteristics of Warner et al. (3) was: 
upper-lower class, 17%; lower-middle class, 
59%; upper-middle class, 20%; and lower- 
upper class, 4%. The Ss were more intelligent 
and better educated than national averages. 
Their median Wechsler-Bellevue full-scale IQ 
was 123. Concerning their educational back- 
ground, 7 per cent had not completed high 

were high school gradu- 


school, 29 per cent 
ates, and 64 per cent had attended college. 


Protocols 


While 


tentially u 
dom of movement T! 


pled by a variety 0 


the SRI method of analysis is po- 
seful for the assessment of free- 
eflected in behavior sam- 
f personality assessment 
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iques, the present study was limited to 
prune te a of its applicability for the 
analysis of two separate kinds of protocols: 
(a) a clinical psychologist’s descriptions of 
the characteristic behavior of the Ss in vari- 
ous areas of their life, and (b) interviews with 
Ss concerning their behavior in these areas. 
The former protocols will be called observer 
descriptions and the latter will be designated 
subject interviews. ; 
The observer descriptions were obtained 
from a clinical psychologist, who, as a Fels 
Home Visitor, had regularly visited the Ss in 
their homes at least twice a year as part of a 
continuous Fels Home Visit Program investi- 
gating maternal behavior and child develop- 
ment (1). In addition, the Home Visitor had 
observed and interviewed the Ss from time to 
time at the Fels Institute. The observer de- 
scriptions, based on the Home Visitor’s total 
knowledge of each S, covered the following 
areas: (a) general methods of dealing with 
day-to-day situations, (b) housework and 
home-centered activities, (c) maternal be- 
havior, (d) marital relationship, (e) inter- 
actions with friends, and (f) social and com- 
munity activities. These descriptions were 
spontaneous verbal reports told to the senior 
author by the Home Visitor without previous 


preparation. They were electrically recorded 


and typed for subsequent SRI analysis. They 
averaged just under five hundred words in 
length. 

The subject interviews were conducted by a 
second clinical psychologist, also a Fels Home 
Visitor, who individually interviewed 41 Ss 
at the Fels Institute. These interviews coy- 
ered the same areas of the Ss’ activities as 
did the observer descriptions. During the in- 
terviews standard questions were employed, 
designed to elicit not only the S’s descrip- 
tions of experiences in each area, 


but also 
her satisfactions and dissatisfactions with 
these experiences. The interviews averaged 
one and one- 


quarter hours in length with the 
Ss’ verbalizations during the interviews av- 


eraging approximately seven thousand words. 


1 The authors would like to ex] 
tion to Fels Home Visitors, 
Mrs. Anne Preston, for their 
study. 


press their apprecia- 
Dr. Joan Lasko and 
participation in the 
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3 ieee ded ically rë 
These interviews were also electrical r 
corded and typed for subsequent SRI analyst: 


Social Reinforcement Index Ratings 


y 
While the SRI method of analysis result 
in a global estimate of an S’s over-all free 
of movement, the ratings upon which F 
estimate is based are not global ones. Te 
were purposefully avoided. Global rati a 
have the mixed blessing of allowing the ve 
to base his judgments on the total con a 
of the situation as he views it. He is on. 
attend selectively to certain behavioral re e 
ents and to minimize or ignore others. of p 
weighs the importance of a given instanc 
behavior as he sees fit. Such ratings are a 
dependent upon the rater’s personal sys 
of “clinical beta weights.” The moderate ed 
poor interrater agreement frequently obte 
with global ratings may sometimes have this 
the result of the individualistic nature of 
process. aod 
One potential answer to this problem, a 
the one used in SRI analysis, is the uti AC 
tion of specific, relatively small, yet PSYC h 
logically meaningful, rating units. With e 
a method, the rater is not free to base ion 
final judgment on his idiosyncratic deer 
concerning the relative importance of bar: 
aspects of the behavior he is rating. Pe 
his sole task is to note when scorable Ba js | 
ior occurs, and to categorize the nature © tersi 
behavior. Such a process simplifies the ra ho l 
task, yet still allows him to make psy | 
logically meaningfu] judgments. da 
The scoring unit of the SRI was define e 5 
“any reported attitude or behavior of t f 
or of persons with whom he interacts W sẹ 
indicates the effect of this experience ot nan 
S.” The unit was scored positive when it ati 
tained an experience which was judged er 
A 


+ 


= 
= = ae 
——— —, 


fying or rewarding for the S; the unit so" 
Scored negative when the social reinforce™ y 
was judged to be an unsatisfying, nonrew" i 
ing or frustrating one. In general, raters "ts 
instructed to rate only behavioral rete aC 
from which they could directly infer sat} 

tion or dissatisfaction on the part of Fi ye 
being rated, However, occasionally, whe? w% 
satisfaction or dissatisfaction of the iud 
not directly inferable, it was possible to ‘ 
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x expected effect of the experience upon the 
A On these occasions, the raters judged the 
Seog positive or negative social reinforce- 
the mong oe in such behavior in terms of 
beha ig reinforcement value for this kind of 
T vior within the S’s cultural groups.’ 
T - SRI was developed to simplify the rat- 
mie prt and should, if it were successful 
chol aon be usable by raters with little psy- 
ogical training and experience as well as 
dene clinicians. To test this, psy- 
as Sand inexperienced persons were used 
Server Pec in the present study. The ob- 
were a Iptions and the subject interviews 
ents or by two senior undergraduate stu- 
foe ajoring in psychology.* These raters 
whose contact with, or knowledge of, the Ss 
weet they rated. A training session 
iniz Ags actual rating of the protocols. 
shal Lg training session, the SRI method 
senior i was explained to the raters by the 
on a z hor, the raters made practice ratings 
study alf-dozen protocols not used in the 
cussed ma these practice ratings were dis- 
tions, Th relation to original scoring instruc- 
Protocol e raters then independently rated the 
ent ee ee final SRI score 
ing the protocol was obtained by subtract- 
reinforce: sum of the units scored for negative 
tentaron from the sum of the positive 
otal 1 ement units, and dividing this by the 
number of scored units. 


of 


Results 


bee ~ I ratings of the protocols were com- 
Overall te Home Visitors’ ratings of the Ss 
Visito freedom of movement. The first Home 
r rated the 72 Ss she had discussed in 

oe et descriptions, and the second 

Viewed isitor rated the 41 Ss she had inter- 
. Each Home Visitor based her ratings 

all “a total knowledge of each S gained from 
er ee and interviews of that S in 
ratings w and at the Fels Institute. These 
Sive k were thus based on relatively exten- 
nowledge and made by experienced 


unite meograph copies of examples of reinforcement 
in the ored for positive and negative reinforcement 
May Observer descriptions and subject interviews 
ra © obtained from the authors. 

Junior y Social Reinforcement Index rater 


author and Miss Barbara Fisher- 


s were the 


clinical psychologists. The SRI ratings, in 
contrast, were made by undeygraduate stu- 
dents with little psychological experience, and 
were based solely on the Ss’ protocols. 

The junior author’s SRI scores of the ob- 
server description protocols were correlated 
with the first Home Visitor’s ratings of the 
Ss she had described.* An r of .81 was ob- 
tained, indicating high agreement between 
SRI analyses of the descriptions and the 
Home Visitor's judgments of the Ss’ over-all 
freedom of movement. The junior author's 
SRI scores of the 41 Ss’ verbalizations dur- 
ing the subject interviews were correlated 
with the second Home Visitor’s ratings. The 
SRI analyses of the Ss’ responses 
interview bore considerable 
he Ss’ observed freedom of 
y the second Home 


z was .67; 
during a single 
relationship to t 
movement as rated b 


Visitor. a 
aing the reliability of 


Information concer! 
the SRI ratings was also obtained. Forty of 
randomly 


the observer descriptions were 
picked, and the two SRI raters’ scores for 
these protocols were correlated. The correla- 
tion was .96. The correlation between the SRI 
scoring of the two raters on the 41 subject 
interview protocols was .87. Intrarater reli- 
ability of SRI scoring was obtained by com- 

ratings of the junior au- 


aring the original 
Tor “with reratings done one month later. 
The correlations were 96 for the observer 


descriptions and .92 for the subject inter- 


views. 
Discussion 


The general results of the study are en- 


couraging. The SRI analyses of the protocole 
resulted in reasonably reliable estima a : 

the Ss’ over-all freedom of movement 2 
addition, even with psychologically ieper 
enced raters, inter- and intrarater garbem l 
was high. These conclusions, of course, ae 
be limited to the kinds of protocols ana om 

in the study- While the SRI appears to E a 
fruitful method for analyzing such diverse 
data as TAT stories, incomplete sentence re- 
sponses, autobiographical material, or time 


reported are Pearson 7’s. Distri- 


4 All correlations s 
butions of scores upon which these correlations were 
pased were all normal, and all relationships were 


rectilinear by inspection. 
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samples of ongoing social behavior, its ap- 
plicability fortthese data must be assessed in 
future research. Finally, it should be pointed 
out that the use of the SRI is not necessarily 
restricted to the evaluation of over-all free- 
dom of movement as in the present study. 
It may also prove useful, both clinically and 
experimentally, for the assessment of freedom 
of movement in respect to specific needs, 
value areas or social roles. 


Summary 


The aim of the study was to deal with ad- 
justmental aspects of behavior from the point 
of view of one theory of personality, and to 
develop a method of analysis within this con- 
text which might be applied to behavior sam- 
pled by a variety of personality techniques. 
The Social Reinforcement Index was devel- 
oped for this purpose. 

The Social Reinforcement Index method of 
analysis was employed by two raters to ana- 
lyze independently two kinds of protocols: 


and Ursula Bellugi 


(a) a psychologist’s descriptions of Ss’ be 
havior in various areas of their life, and (b) 
recorded interviews with Ss concerning thes? 
areas. The Social Reinforcement Index scores 


derived solely from the ratings of these ae | 
tocols by relatively inexperienced raters wel 


7 


compared with ratings of the Ss’ freedom ° 
movement by psychologists who had exten- 
sive experience interviewing and observing the 
Ss. Correlations were high. Social Reinforce 
ment Index ratings also had high interrate" 
and intrarater reliability. : 


Received May 13, 1955. 
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a ari of this paper is to present a 
conceptu À the delineation of an individual’s 
cepted : structure. It has long been an ac- 
each in A sin of projective psychology that 
ture on pr imposes his own unique struc- 
as a ba the world about him. Accepting this 
tease rar assumption, one is next required to 
Vidual je the dimensions utilized by the indi- 
mon “4 this structuration. This is a com- 
technique of the various extant projective 

e la: But whereas in these techniques 
an infe elineation rests rather heavily upon 

i rential structure which may vaty 
another, it is 
be described 


jability to 


Wide 
Diese from one test analyst to 
ed that the technique to 


elow 
‘a mi teduces such inferential var 
unimum 


T 

he Role Construct Repertory Test and 
Underlying Assumptions 

ns are believed to 


The following assumptio 
for the derivation 


e the min; 
minimum necessary 


of t 
a present technique: 


Verse of each individual there exi 
enviro persons which constitutes 
nment. 
Mien individual possesses 
Period cts which is relatively stab € 
urin of time, and which he utilizes 1 
e A his social environment. 
vi da auets contained in a 
the s repertoire bear a relations 
r such that they may be ordered t 


Trh: 

inai study draws heavily upon the Personal cor- 

autho neory of George A. Kelly (2), although the 

ng OTS accept full responsibility for the assumptions 

this Present form of this paper. The data upon whic 

te elas is based were collected while the authors 
in residence at the Ohio State University: 


sts a uni- 
his social 


a repertoire of 


table over a 
n struc- 


given indi- 
hip to each 
o cer- 
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tain basic dimensions which define the pa- 
rameters of his construct repertoire. 

d. The structure of an individual’s social 
environment may be duplicated by an ob- 
server through knowledge of the parameters 
of his construct repertoire. 

An individual’s constructs are viewed in 
much the same fashion as the constructs of 
the scientist. They are the ways in which or- 
der is brought to the unordered, and the bases 
upon which predictions about outcomes of 
behavior are made. Defining a construct as 
a way in which two or more things are alike 
and at the same time different from one or 
more other things, Kelly (2) has developed 
the Role Construct Repertory Test (RCRT) 
as a means of eliciting an individual’s con- 
struct repertoire. 

One form of the RCRT consists of two 
parts: In the first part there is a list of 15 
role titles such as: Your mother or the per- 
son that played the part of your mother; A 
person who for some unknown reason dis- 
liked you; A teacher for whom you had a 
great deal of respect; etc. For each of these 
titles S writes down one name and may not 
use the same name twice. In the second part 
S is presented with 15 combinations of these 
people taken three at a time and is asked to 
indicate in a word or phrase how any two in 

the same and at the same time 


each triad are i ; 
e third. This constitutes a 


different from th zon 
construct. He is then asked to indicate what 


he feels to be the opposite of the construct 
he has just listed. Thus there are elicited 15 
constructs and their opposites. Using college 
students and a slightly different form of the 
RCRT, Hunt (1) obtained a test-retest agree- 
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ment of 70 per cent on constructs used, in- 
dicating some’ generality for the constructs 
elicited. 

Having obtained a sample of the individu- 
al’s construct repertoire the next problem in- 
volves ordering these to certain dimensions 
which may be said to represent the parame- 
ters of his construct repertoire. It will be ap- 
parent to the reader at this point that this is 
a similar problem to that found in psycho- 
metrics, where one has a large number of 
scores on various tests and wishes to reduce 
these to more meaningful dimensions which 
will explain whatever relationship exists be- 
tween these scores. The method of choice in 
psychometrics appears to be factor analysis 
and this method has been applied to the pres- 
ent study. Thus we propose to present the 
application of factor analysis to an individu- 
al’s RCRT protocol as a means of determin- 
ing the manner in which he structures his 
social environment. 

Although some similarity to Osgood’s method 
of deriving his Semantic Differential (4) will 
be noted, one important difference is that the 
dimensions arrived at by the present appro 
are unique for each individual 
scales contained in the Semant: 
are nomothetic in nature, having been de- 
rived from a large group of Ss. While Os- 
good’s procedure permits the specification of 


ach 
, Whereas the 
ic Differential 
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the meaning of concepts in a multidimensional 
space defined by his instrument, we would 
claim that the factor analysis of an RCRI 
protocol permits, first, the specification of 4 
multidimensional conceptual space unique for 
a given individual, and second, the location 
of persons in this space. 


Procedure 


The RCRT as described above was admin 
istered to each of four Ss.? The resulting com 
structs in each protocol were then designate 
as five-point rating scales on which S was t° 
rate each of the 15 individuals named in th? 
first part of the test. The low end of the scale 
meant that the construct was very typical z 
the person, while the high end meant that t 
contrasting or opposite construct was ye 
typical. In order to reduce any halo effec 
the S was asked to consider one construct Pi 
a time, rating all of the individuals in S 
cession. aS 

One can thus conceive of the constructs ° 
tests on which there are as many score 
there are people rated. It is recognized 
the correlations which result from this the 
cedure will be affected by the fact that 
individuals rated on a particular const" 
may have also entered into the formulat! 


S 
that 
pro” 


a fou! 
*In order to conserve space only two of the 


cases are presented. 


Table 1 
Constructs and Orthogonal Factor Loadings for Case I 

Constructs Factor loadings 
Construct Contrasting construct I IL 1m Iv m 
1. unassuming pretentious 3 
2. creative uncreative; static A g 27 —09 > 
3. rigid . flexible ne 4 a 12 39 
4. original; daring unoriginal; conventional 03 E =55 —53 50 
$; sincere; unaffected insincere; affected —19 = “0 s 98 
6. aggressive submissive 13 p 33 07 70 
7. sexual asexual a tC E 30 72 
8. intelligent stupid Ga 00 03 10 53 
9. refined crude 30 id 92 02 30 
10. intellectual non-intellectual 15 12 al 13 89 
11. non-productive productive 05 02 89 23 45 
12. liberal conservative 4 ip re —62 —25 33 
13. ascetic sensual a i 62 z 36 
14. introjected values experience-derived values —07 a 04 = 42 
i5. socially inept socially skilled o5 14 E B 34 


| 
| 
| 
| 
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pike construct. It was apparent, however, 
fect te correlations were not uniformly af- 
-Cted since they range from high positive to 
igh negative. D 

Eor intercorrelations between constructs for 
stone hi factor analyzed using the Thur- 
rotated ie ae e method. Factors were 
loedinns o orthogonal simple structure. The 
lke were then adjusted by the W herry- 
in an Pores (5) so that no residuals 
ve on the tables exceeded = .15. Ninety- 
tables a of the residuals in each of the 
OF great ere between +10. Loadings of .30 

€r were considered significant. 


Results 


si . . 
method the purpose of this paper is primarily 
Presen ological and heuristic, no data will be 
actor > other than the constructs with their 
S. Oadings and a brief description of the 


pk A 31-year-old, single male gradu- 
Y his — considered a “capable” person 
“old f Ssociates. He comes from one of the 
Sctibed Maes. of the South and has de- 
e is m is home as somewhat puritanical. 
tivity Ea concerned with problems of crea- 
Table t e Sopal freedom. , 
and orth presents his construct repertoire 
these fa Ogonal factor loadings. We consider 
Of this Te to be an operational definition 
vironment mode of structuring his social en- 
factors tic To attempt to give names to these 
While bane appear to be of dubious value, 
Pecting each factor for those con- 


at 


Structs q: 
8 Mik Significant loadings will provide 
the Some insight into the ways in which 


Worlds attempts to make sense out of his 


F 
ali pout is clearly concerned with sexu- 
Sexua With the probable identification of 
repression” Tession with liberality and sexual 
Dect On with conservatism. One might sus- 
= ese that since he describes his family 
nical, he would perceive them as 


3 W] 
hil 
tablish © no attempt is made in this article to €s- 


ucthoq of Validity status of the RCRT or our 
in tically t analysis, it might be mentioned pare 


z hat h 

i Which pt 2 faculty member in the dep: 
re ees S was a student identified the S 
n althoug upon reading this analysis of his proto- 
8h he had no knowledge that the student 


in the study. 


tudent 


conservative and hence not condoning sexual 
expression. The fact that at 31°he is not mar- 
ried may indicate a closer tie to his family 
than he would be willing to admit. These of 
course are in the nature of low order hy- 
potheses which such a protocol, taken to- 
gether with other information, might generate. 

Factor II appears to be an affective or atti- 
tudinal dimension by means of which people 
are seen as either unassuming or pretentious 
with the further implication that persons who 
are unassuming, submissive, and refined are 
more to be trusted and relied upon than those 
for whom the opposite might be true. One 
would be led to predict here, among other 
things, that this person might have difficulty 
relating to persons in certain occupations or 
social strata where a premium is placed on 
aggressiveness. Similarly he may be an un- 
duly submissive individual because of the 
negative implications of aggressiveness. How- 
ever, he would probably see this more as be- 
ing flexible than submissive. 

Factor III seems to reflect his concern with 
ual freedom and creativity. Interest- 
also find that the constructs “aggres- 
sive-submissive” and “refined-crude” have 
significant loadings on this factor. Here it 
appears that creativity and intelligence also 
carry certain emotional connotations for him 
and that, perhaps, he is not able or willing to 
accept a person purely on the basis of his ae 
complishments in a given area, but also men 
for certain nonintellectual components as we z 

Factor IV may be the dimension by on 
he discriminates between people ke are a 
his family and those who are not. dug ct 
interested in transference relations. ye 
Jems, we might view this factor as med : a 
the transference. We might expect, F wil 
were true, that having placed a pee = 
figure on the same end of this = arg? 
his family, he would then transfer h a8 
many of the attitudes he holds in ge Bii 
his family. Such information would be i 
valuable to a clinician working with this 
bo I. By way of contrast we present the 
factor analysis of the RCRT protocol of a 
48-year-old female graduate student, mar- 
ried, and mother of two children. At the time 
of this study she described herself as con- 


intellect 
ingly, we 
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Table 2 


Constructs and Orthogonal Loadings for Case II 


Constructs Factor loadings 
‘ons 
7 E 
Construct Contrasting construct I IL Til x a 
i ing closed mind, “set in ways” 91 25 00 w g 
= bet agers cote em distorted, inadequate concepts p A 95 
3. a eii inward looking, self-secing only 96 — 3 y in 69 
å. A on firm emotional foundation - 18 12 93 
$. vital in thinking conventional in thinking 84 = o 6 86 
6. gentle severe, critical | , 88 a6 ie an Ae 
7. masculine dominating leading, not driving =H - E 72 
8. likeable irritating i o9 2 2 aa a 
9. devoted to a purpose takes life as it comes , 32 A s $ 71 
10. not satisfied with taking other does no individual thinking 63 2 3 F 
RR : “i i 
11. By ss ae ideas not interested in philosophical ideas 73 57 S | 99 
12. broader outlook limited outlook 85 32 ot 56 
13. stolid high strung —23 oo = 1 K 94 
14. resentful accepting — —97 03 02 a 34 
15. don’t see me as a person sympathetic =O =03 OF 


fused about the future and considering a 
fairly radical vocational change. Without go- 
ing into the protocol in the same detail as 
the previous one, one is immediately struck 
by her concern about being accepted, about 
a Weltanschauung, and about emotional sta- 
bility. If one were working with this woman 
clinically, he would be particularly interested 
in the relationship between the construct 
“masculine dominating—leading, not driving” 
and the rest of the factor on which it is 
loaded. Does she indeed see males as domi- 
nating, “set in ways,” and generally unthink- 
ing? If so, how does this enter into her pres- 
ent difficulty? Does she see herself frustrated 
because this is essentially “a man’s world”? 
These are just a few of the questions and hy- 
potheses which a clinician would raise on the 
basis of this protocol. 


Discussion 


We have presented what we believe to be 
a useful and reliable approach to the “map- 
ping” of the individual cognitive structure, 
In its present form it would be impractical 
except for research purposes. However, Kelly 
(3) is developing a nonparametric equivalent 
to factor analysis which would permit one to 
factor a protocol in about one hour’s time, 
We would like in this section to sketch some 


eye 
of the research possibilities which we belie” 
are opened up by this method. crt 
Not losing sight of the fact that the R! oe 
is a sorting test akin to other concept-foF 
tion tests, one immediately wonders wha wee? 
qualitative relationships might be ag 
the constructs elicited by it and the ally: 
cepts elicited by these tests. More specifice 7 
since here we obtain a picture of the rela ai 
ship between constructs, there are Ce" 
questions amenable to investigation a $ 
first time. For example: What is the Si? 
cance of the number of factors cong face 
there a relationship between number ° itiv? 
tors derived and complexity of o cor” 
structure? If so, what are the behaviora ture? 
relates of complexity of cognitive struc wif 
Does the number of constructs having sig ig 
cant loadings on a given factor have an 
nificance? One might suspect that the 
the number of constructs significantly 104) gt 
on a given factor, the more important ian 


D 
rg” 


dimension is for the individual. Does a 
torial structure change along develop™ 
lines? 


el” 

Aside from the content itself, there are incl 

tain implications for clinical research. e 

the factors derived are to a good extent tb? 

result of functional relationships whic cot 

individual himself has imposed upon his pie? 
structs, one wonders at the extent to W 


A Factorial Study of Personal Constructs 57 


is Is aware of this functional relationship. 
ome one might be interested in the 
tional sah of accuracy of awareness of func- 
relati selafiontips between constructs. Such 
haina eee DE Shen Hy having the 
as ma ual attempt to sort his constructs into 
Getere groups as there were factors, and 
grou Sl the correspondence between his 
aah ng and the factor grouping. Corre- 
of ae could be construed as one form 
ae “ny and might be expected to vary with 
in aE; adjustment, age, success or failure 
ested ychotherapy, etc. The clinician, inter- 
flatten is in problems of interpersonal 
areas j 1P, could easily investigate such 
asins wating erence; identification, etc., by 
Protocol. an inverse analysis of the same 
fre anin the role titles as the variates. 
velo gain it would be interesting to study 
PMental trends. 

Biler er research opportunities present them- 
Psycholo, the fields of social and industrial 
amon o8y where one might be interested in, 
structs Other things, the commonality of con- 
telationshin S members of a given group; a 
cognitiv ip between nature and structure 0 
e e structure and leadership ability, etc- 
dache lem of communication could be ap 
Nstr through the study of the persona 
ucts of the communicators. From the 
Point of communication, this technique 


pr 
Co; 


‘Ovi . . 
vidas S a means of reproducing each indi- 
Study ` Personal coding scheme. One might 


trang Such problems as ability to receive and 
content, information as a function of the 
Systems and structure of individual coding 

One l} 
to th a 
is ng 
tests 


Quest; 


st point should be made with respect 
€ Problem of validity. In one sense there 

Such thing as an invalid test, since all 
Measure something, and it becomes @ 
on of semantics whether the right name 


has been applied to it; the more important 
question as we see it is pertinence. The re- 
sponses of an individual on the RCRT con- 
stitute a phenomenon; by means of factor 
analysis we impose a certain structure upon 
this phenomenon, and now the problem be- 
comes one of the pertinence of this phe- 
nomenon and this structure. The entire body 
of this discussion has been devoted to the 
description of a program which we believe 
would yield an answer to this question. To 
the extent that the information yielded by 
the RCRT and its factor analysis is found 
to be functionally related to other psycho- 
logical phenomena, the technique has perti- 
nence. In this spirit we offer the technique 
to the psychological public. 


Summary 


A method is described whereby factor ana- 
lytic techniques may be applied to the con- 
cepts formed by an individual on a sorting 
test called the Role Construct Repertory 
Test. Two cases are presented for illustrative 
purposes and the research implications of this 
method are discussed. 


Received May 9, 1955. 
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Efficiency of Attitudes, Fantasies, and Life History 
Data in Predicting Observed Behavior’ 


George W. Fairweather, Louis J. Moran, and 
Robert B. Morton 


VA Hospital, Houston, Texas 


This study investigates the efficiency with 
which three frequently used sources of in- 
formation, viz., attitudes, fantasies, and life 
histories, predict tuberculous patients’ overt 
ward behavior. 

In structured interviews, each of 140 pa- 
tients responded to 132 life history items 
and 45 attitude items. In addition, ten TAT 
cards were administered to 39 of the 140 pa- 
tients. Concurrently, all patients were rated 
by two nurses and two aides on 64 ward be- 
havior items. 

From this pool of items, three ward be- 
havior scales, three attitude scales, and two 
life history scales were constructed. The three 
ward behavior scales and the three attitude 
scales concerned adjustment to (a) regula- 
tions, (b) personnel, and (c) peers. The two 
life history scales concerned developmental 
adjustment to (a) control and (b) peers. 
Each response to every item in all scales was 
given an a priori adaptation score so that the 
higher the adaptive significance of a response 
the higher the score. The total score for any 
scale was the sum of the item values compris- 
ing that scale. 

The 39 TAT protocols were scored, 
quency count, on the follo 
mensions: (a) hostility, 


by fre- 
wing fantasy di- 
(b) clear or weak 
1 An extended report of this s 
rials may be obtained without 
B. Morton, Veterans Administra 
ton 31, Texas, or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. 4692 from ADI Aux- 
iliary Publications Project, Photoduplication Serv- 
ice, Library of Congress, Washington 25, D. C, 
remitting in advance $1.75 for microfilm or $2.50 
for photocopies. Make checks payable to Chief, 
Photoduplication Service, Library of Congress, 


tudy and test mate- 
charge from Robert 
tion Hospital, Hous- 


: d 

perception of the parent, (c) aspiration, 140 
(d) inactivity. In addition, 33 of ny to 
patients, who remained in the hospital jor 
15 months after the initial ward nee 
ratings, were again rated on the same t 
behavior scales, tris 

A 12 by 12 tetrachoric correlation m2 
was computed with the initial data. ot 
matrix revealed that attitudes, life wer 
data, and fantasy dimensions were not pree 
nificantly related to the scores on the rela- 
ward behavior scales. However, the saps 
tions among the three ward behavior SC 
were .66, .66, .76 (p< .001). Further 
follow-up ward behavior scores yielde wi 
following product-moment correlations tae 
the initial ward behavior scores: (a) a 
tion to regulations .60 (p < .01), (b) cpl 
tion to personnel .27 (p> .05), (c) adap 
tion to peers .59 (p<.01). eff 

These results indicate that the moet pe 
cient predictor of one aspect of curren yio" 
havior is another aspect of current behav jg- 
For example, current adaptation to ree", 
tions Predicts, with reasonable apura a d 
patients’ current adaptation to personne’ Se 
peers. Further, the significant correlations ies 
tween initial and follow-up behavior e d 
in the areas of adaptation to regulations yiot 
Peers intimate that one aspect of beha gt 
predicts, within moderate limits, subsed! de 
similar behavior. More generically, er is” 
ings suggest that the closer in conceptua® ge- 
tance the independent variable is to the wi! 
pendent variable, the more accurately 
the latter be predicted from the forme! 
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Double Alternation: A Measure of Intelligence’ 


Allen Hodges 


Southern Minnesota Mental Health Center 


Since j 
cule aie formulation by Hunter (5), the 
nized as pea problem has been recog- 
esignated aie of an implicit process 
animal or h reasoning. The subject, whether 
temporal ot must respond in terms of 
ifferential pn under conditions where no 
adaptabilit ensory cues exist. Because of its 
tion prob] y, versions of the double alterna- 
Parative ne have been widely used in com- 
(1, 4, 5, as of intelligence in mammals 
“Our Saal 
k ae been reported using the 
izene re ion technique as a measure of 
ge student with human subjects. With col- 
Ported co s as subjects, Gellermann (2) re- 
Problem rrelations between solution of the 
age to T chronological age and mental 
tively, Hu 28 +.11 and .58 + .09, respec- 
ren oe and Bartlett (6), using chil- 
relation of the ages of 2 and 6, found a 
trials TE of .86 = .03 between a number of 
Chinn to solve the problem and 
Was fone age; a correlation of .81 = .04 
mental age between a number of trials and 
tol P 
ectives or” and Pascal (10), using mental de- 
Performan subjects, found double alternation 
ured mE, e to correlate .83 + .03 with meas- 
tionship al age, while no significant rela- 
Hodges GS found with chronological age- 
aa public school children, Si 
; 5 bet rrelations of .78 + .03 an 
Mitton se ee of the double al- 
From oa and CA and MA. 
ese studies with human subjec 


intel] 


ts, 


relati = = 

Th tionship between measured intelli- 
e * 

E. o, y,cuthor is indebted to Drs. G- R. Pascal, 

versity 


of pi Milt 

Dle: ennessee f ana E. E. Cureton of the Uni 

ba, ting t e Ea advice and guidance given in com- 
Seq, issertation upon which this article 15 


gence and double alternation behavior is evi- 
dent. The purpose of this paper is to equate 
measured mental age with performance on 
the double alternation problem. Because of 
the nonverbal qualities of double alternation 
behavior, a test of this behavior could be a 
valuable addition to the clinician’s test bat- 


tery. 
Method and Procedure 


Selection of Subjects 
A stratified sample of elementary school 


children was selected.” 


The following selective criteria were used: (a) Only 
included. (b) All subjects were ad- 


male subjects are 1 
ministered the Primary Mental Abilities Test (11). 


(c) Two hundred and forty subjects with PMA 
IQ’s ranging from 80 to 120 were subdivided into 
six chronological age groups. (d) While subjects 
were not individually selected on the basis of socio- 
economic status, all subjects were drawn from school 
districts in which family earning power, educational 
level of parents and type of housing were com- 


parable. 


Table 1 contains t 
tal age characteristi 


employed. 


he chronological and men- 
cs of the six age groups 


Table 1 


Chronological and Mental Ages of the Subjects 


Chrono- 


logical Mental 

Age age age 

group N mean o mean o 

6to7 40 6.54 31 6.21 84 

7to8 40 7.50 .28 7.59 93 

$to9 40 gat 34 8.15.77 

9to 10 40 940 39 9.25 81 
10to11 40 10.39 -36 10.41 63 
11to12 40 11.41 24 11.42 69 


2 All subjects were obtained from the Oak Ridge, 


Tennessee, Public Schools. 
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The Double Alternation Card Test 


Each of the 240 subjects was administered 
the Double Alternation Card Test individu- 
ally. The Card Test was introduced by J. 
McV. Hunt (9).? The only materials needed 
are five ordinary playing cards and a record 
sheet. Four of the five playing cards are black 
(either spades or clubs) while the fifth is red 
(heart or a diamond). The red card is desig- 
nated as the goal card. 

The five cards are arranged out of vision 
of the subject and placed face down on the 
examining table. The goal card is placed ac- 
cording to the double alternation sequence, 
twice on the left end and twice on the right 
end (LLRR). The subject is simply in- 
structed: “Find the red card.” 

The complete sequence of LLRR or four 
complete presentations comprises one trial. 
The subject’s errors are recorded as the sub- 
ject seeks the goal card. The test is con- 
tinued for thirty trials or until the subject 
successfully solves the problem by picking 
the goal card for two successive trials. 


Six quantitative scores were derived from 
the Card Test. 


1. Success or Failure. This is a dichotomy score of 
whether the subject obtains the criterion of two cor- 


rect successive trials before a total of 30 trials is 
presented, 


SIn a forthcoming article, 


Dr. Hunt will descri 
the Card Test in more detail. escribe 


Hodges 


2. Verbalization or Nonverbalization Score. If the 
subject successfully solves the problem, this score 
whether the subject can verbalize the answer. wi 
young children, the problem is scored as “Verbalize 
if the child states: “You put the red card two pe- 
here (points correctly) and two times here (poin 
correctly) .” =. 

3. The Number of Trials Score, This score 35 b- 
number of trials which the subject uses before 0 
taining the criterion of success. i r. 

4. The Number of Total Errors Score. This sco” 
is the total number of errors made by the subita 
before obtaining the solution, or the total er 
made during the 30 trials. b- 

5. The Errors Prior to End Concept Score. In ve 
serving subjects confronted with the double alter 
tion problem, their first behavior appears to be "i 
and error. After locating the red card on the er y 
the subject recognizes that the goal card is awe 
Placed in the end-most positions. From this time l 
the majority of subjects will turn only the end p 
This point at which the S turns only the end Mere 
for two successive trials is designated as the ors 
velopment of the concept of “endedness.” The e" rise 
committed prior to achieving this concept comP 
the Errors Prior to End Concept Score. 

6. The Errors after End Concept Score. Th to 
is the number of errors committed after form 
of the end concept. 


js sco? 


A seventh score is obtainable which is - 
total Time Score, or the time which elap 
between the first presentation of the C% 
and the solution to the problem. Because 
dexterity of the examiner in handling * 
distributing the cards contributes to the t 
involved in testing, the validity of suc? 
score is questionable. 


Table 2 
Correlation Summary 
è ES 5 > v 
Measures g £8 y 4 5R sgo ? 
g S8 m Ba 58 a¢ 4 
Se 36 8 Eg 5 a8 4 
55 az a =e £283 go 5 
Sa 58 S58 #5 85 fe ¢ 
os PA AE 8s 98 68 ; 
1 2 3 4 5 ó 
1. Solution vs. failure 
2. Verbalization vs. nonverbalization .800* 
3. Number of trials —.680* —.769* 
4. Total number of errors —.633t —.595} 894} 
5. Errors prior to end concept —.219} —.276t 344} 
6. Errors after end concept —.579} —.468} 702+ 165 140 
7. Mental age .597} 536} —.543} has ='999 = 


* Tetrachoric coefficient, 
t+ Biserial coefficient. 
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T Table 3 
Mean Scores of the Six Doubl: i 
Sis e Alte i 
ernation Measures for Each Mental Age Group 
= Solution Verbalization Mean on = pe 
f r or ; 

” ai . or number number fessor ene 
ere nonverbalization of trials of errors end concept re 
7 : concept 
p t u 4 2 Vv 5.8 18.3 14.8 
vo 3 2 s v 9.3 20.3 164 a 
Wo y S V 11.6 29.7 14.5 os 

Do 32 S v 124 35.8 20.2 163 
P01 35 s NV 18.2 55.9 32.2 ma 
foo 37 S NV 19.7 54.2 22.2 ts 
Tios 46 S NV 21.5 61.9 36.7 ais 
G07 36 s—/F NV 21.7 58.7 24.7 F 
1 F NV 26.7 87.3 47.0 21 

1 NV 30.0 99.3 39.2 60.0 

Results Test scores. The use of this equation is lim- 


Table 2 ` 

Pa of he se the intercorrelation sum- 

he Criterion oe on the Card Test and 
oluti al age. 

Trors, an T Failure, Total Number of 
Ete See rrors after End Concept Scores 
ion with th as having the highest correla- 
correlati e criterion variable and lowest in- 

a ons with the other variables. A 


ltipl 

e re . 

Ms the heme : equation was computed 
Ores, ittle method using these three 


he result was: 


Estim; = — 

ated 

(X2) mental age = .24 (X1) ai 
— 09 (X3) +C 


Where: 

: X1 = Solution vs. Failure Score 
(Solve = + .65, Fail = — 

Ph 
= The square root of the Total 
Bae Number of Errors Score * 
= The square root of the Er- 
rors after End Concept 


Score ë 
Č =12.15 


Thi 

AS 

9 e i 

f mental a tion represents the best estimate 
ge obtainable for the three Card 


piy 
tiop ° determi 
n erm 
th vs, Sea the scores to be assigned for Solu- 
cons peteentage Se ‘Valies corresponding to P, OF 
fa Be of failur solution, and Q, which is the per- 
a ormal di te, for the mean deviation of one tail 
aa tian was computed. 
of ag roots of these scores are ne 
quare root transformation prev 


to the data. 


essary 
jously 


ited, however, because of the restricted range 
of ability which it encompasses; i.e., predict- 
ntal ages below a twelve-year level. In 
addition, the need for cross validation is evi- 
dent. When this equation is applied to a new 
group of subjects, considerable shrinkage may 
occur which would alter the predictive value 
of the multiple regression equation. 
To increase t 


he clinical usefulness of the 
Card Test, mean scores have been compiled 
ores on the 


which equate sc! Card Test’s six 
measures with mental age- These means are 
included in Table 3. 


ing me! 


Summary and Conclusions 


1. The purpose of this paper was to equate 
performance on the Double ‘Alternation Card 
Test with measured mental age. Using 240 


public school males ranging in A from 6 to 
mental age equivalents for six 


12 years, 
quantitative scores of the Card Test were 
computed. 

on equation predict- 


2. A multiple regressi 
ing mental age was derived. The usage of this 


equation appears limited because of the re- 
stricted mental age range which can be pre- 
dicted by means of it. 

3, Mean ‘scores for performance on six 
measures of the Card Test, equated with 
PMA mental ages, are included as very ten- 


tative norms. 
4, Because 
Card Test plus 


of the nonverbal aspects of the 
the high correlations between 


62 


measures on this test and measured mental 
age, it is felt that this technique can be a 
valuable addition to the clinician’s test bat- 
tery, particularly in instances where the 
testee suffers language handicaps, aphasia, or 
speech disorders. 


Received May 13, 1955. 
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Esti i 
imating the Full Scale Score on the Wechsler 


Adult Intelligence Scale from Scores 
on Four Subtests 


Jerome E. Doppelt 


The Psychological Corporation 


Ponape ave appeared in the lit- 
Scale. The forms of the Wechsler- 
fon fae ae forms have usually 
tiles of te samples which were 

by Betis hg normal population. 
Was b ated Wechsl (2) reported a study on 
for “eee Ohi Hie a er-Bellevue Scales which 
'S standardiz data Wechsler (3) reported 

he PN on population. McNemar 

tria echsler-Bellen. between total score on 
Make” quartets evue and the best pairs 
€s the point re quintets of subtests. He 
he greater = ‘there can be no doubt 
ased on gigi of the corre- 
dardizat; echsler’s group,” that is, 
on i sample for the W-B Scale, 
pts with less representative 


a brey; 


Stan 


Int nee Febr 

the yience w 1955, the Wechsler Adult 
able echsler-Bel (WAIS), the revision of 
five | he “se Scale, has been avail- 
cose tforman consists of six verbal and 
Scale vt viel iy subtests, and like its prede- 
Many | 5 Sian Performance, and Full 
Mstance. ing to age group. There are 
ub ant a s when users of the WAIS 
Ject’s I fasonably accurate estimate 0 
of the yn giving all eleven sub- 
the effec ome study is an investiga- 
Oe acgeag of a subgroup of 
of scorn the Full Scale Score, which 

Owing M Ne on the eleven tests- 
Were thos emar’s suggestion, the data 
ization o gathered in the national 
anual =, the WAIS and reported in 
). These data are based On 


Fo) 
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samples reasonably representativ 
population of the Taitea ae oe 

The decision as to the number and type of 
subtests to be included in the predictor grou 
is, to some extent, arbitrary. A eormore mike 
must be made between economy of time and 
effort and accuracy of prediction. It was de- 
cided to select the group of four subtests 
which correlates highest with Full Scale 
Score. Although prediction of the Full Scale 
Score was the goal, it was felt that the best 
approach would be to select the two verbal 
subtests which are most highly correlated 
with total Verbal Score and the two perform- 
ance measures which are the best predictors 
of the total Performance Score. 

There are fifteen possible pairs of the six 
verbal subtests of the WAIS and the correla- 
tion of each pair with the Verbal Score (total 
of scores on the six tests) was computed for 
three different age groups: 18-19, 25-34, and 
45-54. The coefficients are reported, in order 


of magnitude, in Table 1. For the ten pairs of 
ts the correlation coefficients 
between eac rmance Score are 
reported for th in Table 2.” 

Tables 1 and 2 sho 
pairs of tests are highly ¢ 
corresponding total scores 4 
on of the samp 
the data is gi 


orrelat 
nd the differences 


ling procedure used 
ven in the Manual 


alculations are given in 
f the WAIS Manual (4). For greater 
tation the intertest coefficients to 
were used. These data were avail- 
the publisher of the WAIS. 


(4, PP- 5-11). 
ic data for these ¢ 


able in the files of 


between the coefficients for successive pairs 
in any age group are very small. The coeffi- 
cients are, of course, influenced by the fact 
that each pair of tests is included in the total 
with which it is correlated, However, the pur- 
pose here is to predict the total on the basis 
of part of the total and consequently this 


“spurious” nature of the Coefficients is of no 
concern. 
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Table 1 l 
j Correlations Between Two Verbal Tests and Total Verbal Score 

Ages 18-19 Ages 25-34 Ages 45-54 ! 

a iE 
Tests F Tests r Tests i 

Inf., Voc. -940 Inf., Voc. -940 Arith., Voc. A 
Arith., Voc. -938 Inf., Sim. -936 Inf., Comp. “940 
Sim., Voc. -938 Arith., Voc. .934 Inf., Voc. ‘939 
Inf., Sim. -936 Sim., Voc. 924 Inf., Arith. ‘935 
Comp., Voc. -933 Inf., Comp. 921 Comp., Voc. ‘933 
Comp., Sim. 931 Comp., Arith. 914 Arith., Sim. ‘930 
Inf., Arith. -930 Inf., Arith, 913 Comp., Arith. ‘930 
Arith., Sim. -929 Comp., Voc. .912 Sim., Voc. ‘930 
Inf., Comp. -925 Dig. Sp., Voc. -912 Inf., Sim. ‘928 
Inf., Dig. Sp. 925 Arith., Sim. 911 Dig. Sp., Voc. 920 
Sim., Dig. Sp. 914 Comp., Sim. -908 Comp., Sim. ‘ofS 

Dig. Sp., Voc. 912 Inf., Dig. Sp. 905 Inf., Dig. Sp. 00) s 
Comp., Arith. 911 Comp., Dig. Sp. 894 Comp., Dig. Sp- ‘908 
Comp., Dig. Sp. 906 Sim., Dig. Sp. 891 Sim., Dig. Sp. "368 

Arith., Dig. Sp. 881 Arith., Dig. Sp. (853 à f 


Arith., Dig. Sp- 


groups. Since the difference between 4 
“best” pairs is negligible, the choice of 
pair to use in a regression equation was a 
to other than purely statistical considerati 

Arithmetic and Vocabulary were selecte use 
the pair of verbal subtests to use bec? | 


ae . age 
first position, respectively, for the three 


they represent a variety of content materi i 
In particular, the inclusion of the arith ig 
content provides a desirable range of 5 
tions for subjective observations in the tes 
Session without loss of statistical accuracy 

The Block Design and Picture Arrange™ w 
pair is most highly correlated with Per! 


ting 


BI. Des., Obj. Assem. 


Table 2 
Correlations Between Two Performance Tests and Total Performance Score 
Ages 18-19 
g Ages 25-34 Ages 45-54 
Tests ¥ a Se 
Tests r Tests 
Bl. Des., P. Arr. .939 Bl. Des., P. A ied ont 
P. Arr., Obj. oo aan AAT 917 ‘9 
a i nr M 
Bl. Des., Obj. Assem. ‘920 p. Smp., BI. Des. 914 P. Comp., Obj. Assem. ‘of! 
Dig. Sym., BI. Des. '918 P. Comp., Obj. Assem. “999 PoCo Bi Des. ‘of 
P. Comp., Obj. Assem ‘916 Arr., Obj. Assem. -906 Di S: Ba Obj Assem. ‘of 
P. Comp., P. Arr. ‘913 P. Comp., P. Arr. -906 DiE ee BL pe ‘oh 
Dig. Sym., P. Comp ‘912 BI. Des., Obj. Assem. .902 Die Se ? P. Comp. “008 
Dig. Sym ý Ob; ‘Assen ‘006 Dig. Sym., P. Comp. -900 P. a mage “A “87 
Dig. Sym. P.A OR: Dig. Sym., Obj. Assem 897 Soe anh ee “80 
g. Sym., P. Arr. .887 Dig. Sym. P Kee 3 E Dig. Sym., P. Arr. 8 
+) P. Arr. J 
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F 5 
aa E in all three age groups. This pair 
A cted to represent the performance 
P 
au nf the scaled scores on the four 
Block a tests—Arithmetic, Vocabulary, 
thas sian and Picture Arrangement— 
Sauls of the - with the Full Scale Score for 
maA ree age groups shown in Tables 
following Ms ne computation was done by the 
‘ey rmula with all the terms available 
e tables of intercorrelations: 


Tata + reroy + rerde + rated 


r, 
labret r = 
Tlapbje+d) 


The , 

she etipis a, b, c, and d identify the four 

he deno identifies the Full Scale Score. 
minator was computed as follows: 


iii ser + š rgo G =j). 
In ise fea 

Wat f° Process of obtaining norms on the 
a ome people, four “old-age” groups 
among th obtained and the intercorrelations 
(1), For e WAIS tests had been computed 
elation Shino of these four groups the cor- 
© Full Sc 7 een the selected four tests and 
sulting co ma Score was determined. The re- 
ons for efficients and the regression equa- 
Sum of predicting Full Scale Score from the 
the E a tests are shown in Table 3 for 
ardization age groups in the national stand- 

fis eg for the four old-age groups. 
Slopes a noted from Table 3 that the 
™ the se e regression lines are very similar 
Practica] a age groups. Indeed, it seemed 
© use 2.5 as the coefficient of the 


Correlati Table 3 
1 
on of Sum of Four Subtests with Full Scale 


A and Regression Equation for 
redicting Full Scale Score 


Regression equation 


Age 
San (xı=Full Scale Score; 
18-19 z r xı=sum of 4 Tests) 
ig W 20 ma 25r + 9-7 
45-54 300 ‘954 sale’ Go 
R R 958 zı = 2.5x2+ 
70769 01 968 x = 23x + 12.2 
ti e -963 xy = 2.32 + 1 

E 957 aes 

ove as Sa aozont 


Table 4 


Estimation of Full Scale Score from Sum of Scores on 
Arithmetic, Vocabulary, Block Design, 
and Picture Arrangement 


Age Full Scale Score= 
group 2:5, S*4- 
16-17 10 
18-19 10 
20-24 10 
25-34 10 
35444 9 
45-54 8 
55-64 7 
65-69 5 
70-74 5 
75 and over 4 


+S = sum of scaled scores on 4 tests (use T: 
Manual). (use Table 17 of WAIS 


predicting variable in each of the equations 
and to adjust the constant term according to 
age of the individual. In this way a regression 
d be determined for each age 
group, including those for which tables of in- 
tercorrelations of the tests had not been pre- 
pared. This table, with the constants given 
as whole numbers, is presented as Table 4. 
Thus, an examiner who obtains the scaled 
scores On Arithmetic, Vocabulary, Block De- 
sign, and Picture Arrangement may estimate 
the Full Scale Score by multiplying the sum 
of the four scores by 2.5 and adding a con- 
stant in accordance with the subject’s age. 
‘An estimate of the Full Scale IQ may then 
be obtained by entering the IQ tables given 
in the WAIS Manual. 

In making any prediction one should al- 
ways have some idea of the error involved. 
In this study the standard deviation of Full 
Scale Scores is about 25 and the correlation 
coefficient between the sum of the four se- 
lected tests and Full Scale Score is approxi- 
mately .96. Consequently the standard error 
of estimate in predicting Full Scale Score 
from the four tests is about 7 scaled score 
points. (This is equivalent to 4.2 IQ points.) 
Thus an estimated Full Scale Score would be 
within 7 scaled score points of the actual 
score about 68 out of 100 times. 

As a check on the equations given in Table 
4, distributions of the actual differences be- 
tween the obtained and estimated Full Scale 


equation coul 
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Table 5 
Distribution of Differences Between Full Scale 
Score and Estimated Full Scale Score 
Ages 20-24 Ages 3544 
Difference* F % f % 
Over 21 1 0.5 
15-21 3 1.5 2 0.7 
8-14 25 125 39 13.0 
0-7 70 35.0 115 38.3 
—7-—1 72 36.0 98 32.7 
—14--8 24 12.0 37 123 
More than —14 5 25 9 3.0 
N 200 300 
Mean —0:1 —05 


*Full Scale Score minus the estimated Full Scale Score 
obtained from Table 4. 


Scores were prepared for age groups 20-24 
and 35-44. These two groups had not been 
used in the correlation analysis which led to 
the regression equations although they were 
used in the determination of age-group con- 
stants. 

The distribution of differences, grouped in 
terms of the suggested standard error of esti- 
mate of 7 points, is shown in Table 5. It may 
be noted that 71 per cent of the differences 


Summary 


An abbreviated form of the Wechsler Adult 
Intelligence Scale was determined by select- 


Jerome E. Doppelt 


ing the two best predictors of the total verbi 
Score and the two best predictors of the tot 
Performance Score. The four tests were Arith- 
metic, Vocabulary, Block Design, and ie 
Arrangement. The selection of tests was = 
on the data obtained in the national stand- 
ardization of the WAIS. the 
The correlation coefficients between iel 
sum of scaled scores on the four tests and j 
Full Scale Score varied between .95 and A 
for the seven age groups studied. A simplifie 
regression equation for predicting Full Eo 
Score was presented in which the sum is 
scaled scores on the four selected tests 
multiplied by 2.5 and a constant is adde 
depending upon the subject's age. a 
The selection of subtests made in this me 
permits an estimate of Full Scale Score pe 
35-40 minutes of testing. The standard one 
of estimate of Full Scale Scores thus obtain j 
is about 7 standard score points. 
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Th 
e Wechsler-Bellevue and Psychiatric Diagnosis: 
A Factor Analytic Approach 


George H. Frank * 


Florida State University ? 


Althou s 
conducted to determine research has been 

chsler- rmine the effi 
Predicting naue Intelligence Test. = - 
Tesults fo maa diagnoses (2, 3), the 
arge, the a been disappointing. By and 
ore than ee that the W-B can elicit 
Mpirically walidai factors has not been 
e usual A 
x to select apes of testing this hypothesis 
equical rps. distinct samples, either two 
atiaj” Do ‘ or a clinical and a so-called 
D test Bitten. ation, and compare the group 
fe of such mea by ¢ or r. Through the 
simi” only a hniques the researcher is af- 
7 ilarity PR Sg measure of disparity oF 

€ reason ut any further information as 

wae interesti for the results. 
pant, Whic mean occurred to the 
for ability but i t provide a measure of com- 
Cig iui a offer possible rationale 
vidu ere to i It was reasoned thus: if 
tse rom si the subtest scores of indi- 
fea, ne ee diagnostic groups and 
sim, Malyze i one correlation matrix and 
and ar Subtest e matrix, the subjects with 
asce, € Teaso patterns would be grouped, 

ĉttained f ns for their groupings could be 

rom other identifying data. 


Method 


n 

Vari a Previ 
ance of ee research (1), analyses of 
subtest scores of subjects sub- 


1 
Ba 
emn pod in 
2 S’ Part o 
3, 1954 Pologica] ee paper read at the Southeast- 
à sociation, in Atlanta, On May 


woma Y 

uld 72t Topek 

Bop m to pra State Hospital, but the writer 

tye Dewnnis, Roe ee the assistance of Prof. 

Sry op rector of th of the University of Wisconsin, 
Onda tee Sociological Research Labora- 
a State University. 


sumed under thirty different di i 
gories were performed. This Ba chs Me 
strated that only nine of these pre 
Smeg ge S groupings of subtest scores, while 
Ld a others proved to be statistically un- 
A further check on the homogeneity of 
these nine groupings of W-B subtest scores 
was made by computing W’s (a method of 
multiple-rank correlation) for each of the 
nine groups. The W’s were high (above .90) 
and significant. Then the subtest scores of 
the sixty subjects from these nine different 
psychiatric groups were intercorrelated, one 
with the other, by the Spearman method of 
rank correlation, and the matrix analyzed 
by Thurstone’s centroid method of factor 


analysis. 

Since the data originally came from Rapa- 
port’s work (4), it was a simple task to turn 
to the data for the identifying characteristics 


of the factor loadings. Thus those high in a 
given factor were compared on the basis of 
their diagnosis, age, S¢%, education, verbal, 
performance, and Full Scale IQ’s to deter- 
mine the communality. 


Results 
Because of the cumbersomeness of a 60 X 
60 correlation table, the original matrix is not 
presented here. However, Table 1 presents 
os of the sixty subjects on 


the factor loading 
the two factors isolated by the analysis of the 


correlation matrix. 
n now arises as to the meaning 


The questio 
of the factor loadings. The immediate con- 
clusion proffered by the data is that psychi- 
s is not the common element of 


atric diagnosi: 
either one of the factor loadings. In fact the 


Sa 
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. . 1 
Anxiety Level and Pursuitmeter Performance 


Ruth G. Matarazzo and Joseph D. Matarazzo 


Massachusetts General Hospital and Harvard Medical School 


The Ss were 80 white, male, VA inpatients 
ranging in age from 18 to 37. The measure of 
anxiety employed was the Taylor Manifest 
Anxiety Scale. Five anxiety groups were used, 
Taylor raw scores of 1 to 8 being given an 
anxiety rating of 1, 9 to 16 a rating of 2, etc. 
Group 5 contained individuals with Taylor 
scores from 33 to 44. The number of Ss within 
each group from 1 to 5 were tai 16; 21; 
and 19, respectively. The five anxiety groups 
were equated for age, education, and total 
Wechsler-Bellevue IQ. Also there were no 
significant group differences in performance 
on any of the eleven W-B subtests, as meas- 
ured by F tests and epsilon correlations. The 
finding of no significant differences in W-B 
scores is important since both Grice and Ker- 
rick and our own group have reported mod- 
erate but significant negative correlations 
(ranging from — .20 to — 40) between the 
Taylor Scale and some measures of “ 
gence.” For the present data, the v. 
the correlation (epsilon) was not sigi 

The learning task was a complex, double- 
disk pursuitmeter loaned by D. Lewis. For 
each S there were 20 trials of 20 seconds each 
followed by 40 seconds of rest. Two measures 


1An extended report of this 
tained without charge from Rut 
sachusetts General Hospital, 
setts or for a fee from the Ai 
Institute. Order Document No. 4748 from ADI Aux- 
iliary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.75 for microfilm or $2.50 for pho- 


tocopies. Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress. 


intelli- 
alue of 
nificant. 


study may be ob- 
h Matarazzo, Mas- 
Boston 14, Massachu- 
merican Documentation 
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of learning were used: gain (the difference 
between each S’s average score on the las 
two trials and his average score on trials 
and 2), and total time on target. > 
Results indicate no statistical relationship 
between either of these two learning n 
ures and Taylor anxiety level. Despite t 
lack of significance as shown by F tests \ 
and .00) and correlation measures (epe 
values of .04 and .22), there was a trend 
the middle anxiety groups (2 and 3) tO 7 
superior learners. This latter finding, while 5 
no interest in itself, takes on some slight re 
nificance in view of the finding of a simi” 
curvilinear relationship in two previous meee 
ies from our laboratory, and two unpublis K 
studies of Spence and Taylor from the Io 
laboratory. seres 
The present negative results are of inte 
in view of the findings of both Grice 
Kerrick, and our own previous work 0? ore 
relationship between “intelligence” and a 
on the Taylor scale. Furthermore the Je 
findings do not support our earlier aa e 
hypothesis that timed tests might be ‘eve! 
Sensitive to variations in Taylor anxiety © 
than are other tests. Nor do the present eni 
ings support our earlier belief that the t" ith 
toward a curvilinear relationship, found Je 
a digit-symbol learning task, was an pa 
of the type of case described by Webb on 
Lemmon, in which the interpretation of 4 i 
Significant F test should be qualified. 


Brief Report. 
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A Validation Study of the Bender-Gestalt’ 


Benjamin Mehlman and Edward Vatovec 
Kent State University 


Tn rece: i 
een ii hei increasing attention has 
cedures to A the application of test pro- 
thology, If e problems of organic brain pa- 
cated (3. 7g implicitly and explicitly indi- 
behavior a of soe are dimensions of 
en test peculiar to the or anic 
guish the pow be evolved which can distin: 
ls to dicen a The purpose of this study 
est reliabl ine whether the Bender Gestalt 
tonal Seeks differentiates organic from func- 
ae ae institutionalized individuals. 
Stalt Test e introduction of the Bender Ge- 
Sign by ihe ea and reproduction of de- 
Scant attenti otic patients had received only 
938, tena by other authors (11). In 
Eures len 4) assembled nine Gestalt 
ons into wh from Wertheimer’s configura- 
Istal Maset is now known as the Bender 
des E Premise estalt Test. This test was built 
E Ba = alc the reproduction of test 
is S of original + -motor act in which distor- 
jen ue to neur ee indicate malfunction- 
Pa levels al injury, variations in intel- 
( ie field of ee maladjustment in the emo- 
a ), in the e perceiving subject. Schilder 
Bh, the test ( pore to Bender’s monograph 
the has tall states that “Personal experi- 
St is =. me that the clinical value of 
et ae It may allow a differ- 
lled functi ween organic deterioration, 
ng.” onal mental disease and ma- 


ha, veral P 
EE aea e pii the Bender Gestalt 
of Wins a functionally ill 
Trig “UNctional] ally ill, and between groups 
(19) 2nd hd ill (1, 5, 6, 13). However, 
) report n (15, p. 148) and Hobbs 
ju, Based eliable differentiations between 
hior author, a master’s thesis submitted by the 


psychiatric patients and nonpatients. Prelimi- 
nary observations by Barkley (2) with plastic 
relief reproductions suggest differentiation be- 
tween organic and nonorganic. 

Halpern (8), writing about the Bender Ge- 
stalt in a text on projective techniques, re- 
ports that where the test has been given be- 
fore and after brain injury or other traumatic 
experiences, the disturbance in personality 
found expression through the resulting distor- 
tions of the gestalten. Woltmann (16) sum- 
k reported by Bender on or- 
ganic brain diseases in her monograph and 
says it proves beyond doubt that organic 
brain disease does interfere with the visual- 
motor gestalt functions. 

These studies, with their variant conclu- 
sions as to the worth of the Bender Gestalt 
Test, have led to the current attempt to clarify 
the worth of this test. This study seeks to de- 
termine whether the Bender Gestalt reliably 
differentiates organic from functional psy- 
chotic institutionalized individuals. 


marizes the wor 


Method 


Psychotic patients from Massillon State 
Hospital, Massillon, Ohio, were used for this 
study. The name, sex, age, diagnosis, and the 
time spent in me itals were recorded 


individually for each of the 3, 
arate file cards. These cards 


were then separated into four groups: one 
which was made up from male patients who 
‘ed an official hospital diagnosis of func- 
ses; another of female functional 
of male organic patients and 
f female organic patients. Eliminated 
roups Were patients who carried 
f mental deficiency. The groups 
ed in order of chronological 


patients; 
the last 0 
from these £ 
a diagnosis 0 
were then arrang! 
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age. It was possible individually to match 118 
functionally psychotic male patients with 118 
organically psychotic male patients of the 
same age and of not more than one year’s 
difference in regard to time spent in the hos- 
pital. This same procedure was followed in 
choosing the female population of the study. 
There were 102 paired female patients fol- 
lowing this procedure. : 

Eliminated from this study were patients 
who had undergone any form of psychosur- 
gery. Also eliminated were any patients who 
had undergone any form of convulsive treat- 
ment within the previous six months. Kali- 
nowsky and Hock (12) summarized studies 
made in this field and came to the conclusion 
that although there is no actual impairment 
of cerebral functioning following a course of 
convulsive therapy, there is some question as 
to how long after treatments have been dis- 
continued these functionings return to nor- 
mal. The six-month period was here consid- 
ered a long enough time for the effect of the 
treatment to disappear. Also eliminated from 
this study were patients who refused to take 
the test, were unable to comprehend the di- 
rections, had markedly poor eyesight or other 
obvious or known physical handicaps which 
interfered with ability to take the test. 

The elimination of patients for the above 
reasons reduced the 118 Paired males to 34 
matched male patients, and the 102 paired 
female patients to 21 matched female pa- 
tients. After the Protocols had been collected, 
two sets of 25 pairs of protocols each were 
selected in unbiased fashion from among the 
pairs of protocols available. 

The design of this study called for sta- 
tistically better than chance differentiation by 
experts between organically and functionally 
ill from the set of 25 matched pairs of proto- 
cols. To give this task to individuals only 
vaguely or incompletely familiar with the 
Bender Gestalt Test as a clinical instrument 
would have loaded the data against finding 
positive results. Sending protocols to experts, 
defined as individuals who had published ac- 
counts of the clinical research use of the test, 
and who were enthusiastic about the test, in- 
creased the likelihood of securing positive re- 
sults. There were eight such individuals lo- 
cated by survey of the literature. One refused 


to participate and several felt unable on s 
ticipate, for reason of time or the like. K, 
accepted invitations to participate, but a 
three returned the materials in comp 
form. Each authority received 25 paired p 1 
tocols, each protocol containing only the oa 
letter “A” or “B,” with instructions to P 


; jona 
either letter under the organic or funct 
column on the answer sheet. 


Results 


Š t 
In terms of our earlier expectancies, H 
there would be approximately eight JU p 
participating, two sets of 25 pairs of ey 
protocols had been arranged. In terms 0 
completed data, two judges used one set 0 se 
and the other judge used the remaining int 
Since the placing of a pair of protocols af 
one or another of the sets was a chance 
fair, there is no reason to believe that 
sets are not equivalent in any respect. ales: 
had 15 pairs of males, 10 pairs of ae ol 
and Set 2 had 16 pairs of males, 9 Ppa! 
females. jd € 
On the basis of chance alone we cou rect: | 
pect each judge to get 12.5 choices nis 254 
Judge A secured 11 successes out of t vel | 


y 
choices in Set 1. Since this represents fee 
successes than the Mean, and since s 
here concerned only with a one-taile the 
this represents a failure on the part i 4 
Bender Gestalt, as utilized by this exper nv 
discriminate successfully between the ore 
cally and functionally ill. ee Bh the 
Judge B secured 17 correct choices d test: 
Possible 25 in Set 2. Using a one-taile 035 
this represents successful choice at the af? 
level of confidence. In other words, there 


iid 
only 3.5 chances in 100 that Judge Be 


test» 


u 


the i 
have been right this number of times 0” 
basis of chance alone. f th 
Judge C secured 18 correct choices Oet , 
possible 25 in Set 1, Using a one-tailed j4 | 
this represents successful choice at the “ye 
level of confidence. In other words, ther wld 
only 1.4 chances in 100 that Judge © © pe 
have been right this number of times ° | 
basis of chance alone. t w 
In summary then, we have found tb che! | 
of our judges attained or closely appren d” 
better than chance expectancy success tio” 
criminating the organics from the fu” 
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ll i 

ea a ea through the Bender Gestalt 
e third judge failed to hav i 

Aa g ave more than 


Discussion 


ou thie Bender Gestalt had been in 
War II sha 1938, it was only during World 
reliable te PE panis was A felt need for a 
thology T to determine organic brain pa- 
stalt Test - the Bender Visual Motor Ge- 
tion. In A the subject for investiga- 
estalt TUI over the studies on the Bender 
the Bender bs can find no rigorous study of 
etween Fle nrg ability to differentiate 
Banically psy eun! psychotic patients and or- 
hë Ae otic patients. 
instrument ent study suggests that while this 
ent experts 1s not used equally well by differ- 
cused ie ee with respect to the highly 
Some it can of this study, in the hands of 
functional reliably distinguish organic from 
in ie While variability in skill 
ing, such neh an instrument is no new find- 
authorities erogeneity as found here among 
Is Particulari, highly select is surprising. This 
l erentiati y so when we consider that the 
Patients HA ns were to be made from among 
Problems: selected as differential diagnostic 
rom pa Coun these protocols were taken 
8e, are t s who, to the best of our knowl- 
eir aa of patients in general from 
ery m ive groups. 

even the to the point too is the fact that 
Wrong in Se successful of our experts was 
Nificance a 25 choices. The statistical sig- 
about the ain not lead to complacency 
tue when ender Gestalt, This is particularly 
Xperts h we recall that the task set for our 
Clinician ere was far easier than the task the 
e jud meets in his daily routine; i€- here 
also Pi having diagnosed one protocol, had 
Judges ceo the other. In addition, our 
ing to a a much more gross kind of label- 
clinica] © than is generally encountered in 
e PE irae That there is some basis for 
cen Geg expressed in the literature has 
Sreater ee here. But the need for 
nement in the use of the Bender 


estalt + 
ai equally apparent. 


Summary and Conclusions 
o 


This study was undertaken to determine 
whether the Bender Visual Motor Gestalt 
Test reliably differentiates organic from func- 
tional institutionalized individuals. 

Twenty-five paired protocols were sub- 
mitted to three authorities of the Bender Ge- 
stalt Test for blind analysis to determine 
whether the experts were able to pick out the 
organic and functional psychotic protocol from 
the matched pairs. Two judges attained or 
closely approached better than chance success 
and another had no more than chance success. 
These results suggest a surprising heteroge- 
neity of skill in the use of Bender Gestalt, 
even among experts. These results suggest 
many mistaken diagnoses, even by the best 
judge. Further refinement in the use of the 
Bender Gestalt is indicated, but the utiliza- 
tion of the Bender Gestalt alone in clinical 
practice is not warranted. 
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Al a . 
to since n ranking method has been used 
is known hy inical judgments (4, 10), little 
liability ont the parameters affecting the re- 

Y this meth ny of judgments measured 
scale, and hod. Characteristics of the stimuli, 
ence the r a have been shown to influ- 

» 3, 6) nee of rating scale judgments 
Method is ut similar research on the ranking 

3 is nonexistent. 
Problem. rsa study was concerned with the 
lish a crit using the ranking method to estab- 
ased ae of clinical material 
tral Proble he judgments of experts. The cen- 
criterion st in establishing such a judgmental 
Perts. A ai ack of agreement among the ex- 
di ong ju ni low average intercorrelation 

Widual jud s does not necessarily imply in- 
Perts ma pa unreliability, but that the ex- 
iudgments e using different bases in making 
Psychologists clinical material. If two clinical 
Using simil s rate or rank clinical material 
Pect them ~ bases of judgment we would ex- 

t they ag show high intercorrelation, but 
Nal their į at different aspects of the mate- 
e oe might be expected 
. endig iy mene os low. As an example, 
'terjudge ound that for esthetic judgments 
Hong ju Leg (average intercorrelation 
unction Ees) is not a simple rectilinear 
“lation f intrajudge reliability (retest cor- 
ion for singe judges). 
Whether a method that can be used to test 
te ment ck are using different bases of 
tion ig į also to purify a judgmental cri- 
nverse factor analysis. Factor- 


Yzin 
Ba R $ 
ftom li matrix of intercorrelated judgmen 


8enera] 


ana- 
ts 


inici i 
ans would reveal whether 4 single 


« 
a $ 
di e i factor can explain the 

ercorrelations or whether & series 
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Ranking Methodolo 
: gy: the Development of 
Judgmental Criterion with Clinical Cass siete 


A. W. Bendig 


University of Pittsburgh 


of independent group factors is necessary. 
In the latter case the group factors would 
offer a means of categorizing the clinicians as 
to those with similar and dissimilar bases of 
judgment. Also the clinical material could be 
made more factorially homogeneous by elimi- 
nating material which clinicians using dissimi- 
lar bases disagreed upon and retaining only 
material that they judge similarly, regardless 
of their basis of judgment. However, the 
“purified” material should be validated by 
having other judges similarly rank the “puri- 
fied” set of clinical material. 


Procedure 

e 50 judges consisted of seven 
clinical psychologists and 43 undergraduate 
students in two sections of a course in mental 
hygiene. All the clinical psychologists had re- 
ceived the Ph.D. degree and had worked for 
a minimum of one year in clinical practice 
with children and adolescents. The under- 
graduate Ss had a minimum of three semester 
hours in psychology with many having more. 
The Ph.D. Ss were contacted individually and 
asked to read and rank for adjustment level 
15 abstracted case histories. They were in- 
heir own clinical definition of 
it was suggested that they 
int the behavior of 


Subjects. Th 


adjustm! 
use as t 
the average child 
The undergraduat 
and a booklet co 
the same case his 
sheet of instruct. 


the Ph.D. Ss was 
The undergraduate Ss read and ranked the 


cases outside of the class and returned the 
booklet at a subsequent class period. 
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Stimuli. The 15 case histories were ab- 
stracted from “longer and more complete cases 
published in a number of texts on clinical 
child psychology and psychiatry.t A standard 
outline was used with each case and the in- 
formation was abstracted under six areas that 
previous interviews with clinical child psy- 
chologists had indicated were most useful and 
necessary. Each case abstract was approxi- 
mately one page of single-spaced typing in 
length. Of the 15 cases selected, 10 were boys 
and 5 were girls. The range in age of the 
cases was from 7 to 16 years old with the 
median at 12 years. 

Analysis. The rankings of the seven clinical 
psychologist judges were intercorrelated by 
the rank-difference method and the resulting 
matrix of correlations subjected to a centroid 
factor analysis. The obtained orthogonal fac- 
tors were analytically rotated to approximate 
simple structure. Each judge’s ranks of the 
15 cases were weighted by his factor loadings 
on the rotated orthogonal factors and a mean 
weighted factor score obtained for each of the 
cases on each factor. The five cases whose fac- 
tor scores showed the greatest intracase dis- 
crepancy were then selected for elimination. 
Booklets containing the original 15 cases or 
the 10 cases after the above elimination 


the two groups o 
significance. 


The centroid factor analysis of the 21 inter- 
correlations yielded three orthogonal factors 
and the analysis was replicated three times to 


1 The° author’s appreciation js extended to Miss 
Phyllis Black for the abstracting of the case histories, 
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Table 1 


Summary of Centroid Factor Analysis of Interjudge 
Correlations of Clinical Psychologists 


Rotated Factor Loadings 


Clinical nee |: 
Psychologist A B c 
A 01 ao o p 
B 79 54 00 54 
€ 73 10 02 89 
D 38 43 75 93 
E 33 90 08 67 
I 68 14 gl 
G 39 83 —30 
4 
Percentage of 
Intrajudge 80 
Variance 29 39 12 
A 


stabilize the communality estimates. After E 
third iteration the mean absolute different 
between the estimated and obtained commi 
nalities was .01, The median absolute residt 
correlation after extraction of the third facto 
was .03.* The original factor loadings W° 
analytically rotated to approximate wage 
structure and the rotated factor loadings re 
found in Table 1. It can be seen that the 
was no general “agreement” factor anione 
judges, but the three group factors obta! 


accounted for 80 per cent of the intial get 


| 
Variability in judgment. Five of the ag ac’ | 
showed large loadings on factor B which ari- 
counted for 39 per cent of judgmental Ls t 
ability, while six of the judges had signific ef 
loadings on factor A which measured ie 
29 per cent of intrajudge variance. Fact? 
Was bipolar and comprised the remaining yj 
per cent of the variation in judgments, this | 
two judges on the high positive end © n 
dimension and one judge on the negative “py 
Judgmental communality as estimate gr 
these three factors varied from 54 to 9 

cent for the seven clinical psychologists: A 


or 

* A table giving the original and residual intone 
relation between the clinical psychologists, the ° yis 
nal factor loadings, and the transformation ta” 
has been deposited with the American Docu tbe Al 
tion Institute, Order Document No. 4744 fron tio” 
ADI Auxiliary Publications Project, Photoduplic® C1 s 
Service, Library of Congress, Washington 25, 77 fof j 
remitting in advance $1.25 for microfilm or $1- hot” 
photocopies, Make checks payable to Chief, P 
duplication Service, Library of Congress. 
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Ranking Methodology with Clinical Case Histories 


Each clinical psychologist’s rank judgments 
vg then weighted by his factor loadings 
oe k Table 1 and a mean weighted score 
tain aa of the three weighted scores was ob- 
with th T n cang and the five case histories 
for eli e largest interfactor variability selected 
tions pep ai New rank-difference correla- 
he te etween the clinical psychologists for 
was A 10 cases were computed and it 
Voa ent that only one general factor could 
tions gen the matrix of interjudge correla- 
judge he mean correlation between these 
Sane these 10 case histories was .69 and 
74, Th s coefficient of concordance (8) was 
or the Aap sums of ranks for either the 10 
cal ps 4 Case: histories assigned by the clini- 
ition’ hologists were used to establish cri- 
the S ranks ordering of the cases. Applying 
ieee Brom formula to the average 
of 88 rl correlations gave a group reliability 
Of 94 n the 15 cases and a group reliability 
istorie or the summed ranks of the 10 case 
S. 

aa ilan containing a face sheet of instruc- 
rt 4 a either the original 15 case histories 
Neous T ove selected judgmentally homoge- 
to talenia T assembled and distributed 
fa nie ents in two undergraduate sections 
the ntal hygiene course. These Ss ranked 
Or 15 cases for adjustment level and 
ssigned ranks were summed for each 
verage interjudge correlations among 
roupg -reraduate Ss within each of the two 
criterion their average correlation with the 
computed fees of the same cases were 
(9). T by the formulas given by Lyerly 
8taduate differences between the two under- 
cance h groups of Ss were tested for signifi- 
(S5, p y the methods outlined by Edwards 
- 136) which Hartley (7) has shown 


their a 


the un 
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to be applicable to rank correlations. The 
summed ranks given by the undergraduate Ss 
to the cases were used to rank the cases and 
these ranks correlated with the criterion rank- 
ing of the clinical psychologists by the usual 
rank-difference method. These results can be 
found in Table 2. Both the average intercor- 
relation among the undergraduate Ss ranking 
the 10 homogeneous cases and their average 
correlation with the criterion rankings of the 
clinical psychologists were significantly larger 
at the .01 level. The average interjudge cor- 
relations were .51 and .28 for the groups rank- 
ing 10 or 15 cases (f = 2.68) while their av- 
erage correlations with the criterion rankings 
were .70 and 47 (t = 3.37). The total ranks 
of the 10-case group showed almost a perfect 
correspondence to the total ranks given by 
the clinical psychologists (rho = .97), while 
the total ranks of the 15-case group was lower 


(rho = .76). 
Discussion 


of the present study agree with 
ndicating that clinical psycholo- 
ow a moderate average in- 
ir judgments, but that the 
nt level among various 
tremely large. For ex- 
ample, the average intercorrelation among our 
seven clinical psychologists was .51, but single 
correlation coefficients ranged from .83 to 04, 
The factor analysis of these amie ieniccioe 
indicated the absence of 4 general ig o 
agreement and the presencè of ae sr 
factors. We suggest that a ae che 
judges on the basis of the pattern the : 
ora factor loadings will result in a oe 
of clinicians internally age em ae 
bases they use jn making clinical Juag i 


The results 
other reports i 
gists as a group- shi 
tercorrelation in the 
variability in agreeme 
vairs of experts is ex 


Table 2 - 
-ing 10 or 15 Case Histories 
Reliability Coefficients of Undergraduate Student Judges Ranking 
pa Average Group 
J ee with corr. with 
of c Number F ize Group corr. wit) . 
Sot 7 on ae pie reliability psychologists Psy chologists 
judges concorda! 
10 g = = T 7 s 
= Fe 32 28 88 : : 
19 32 
toe 3.37* 
"Bnificance of difference (£) 2.68* 


ko 
igni 
ificant at the .01 level. 
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Naturally this is an hypothesis that was not 
tested by the present study, but one that is 
capable of being tested. 

The technique of developing a factorially 
homogeneous set of clinical material by factor 
analyzing expert’s judgment appears to be 
generalizable to the judgments of naive, less 
experienced judges. The student Ss ranking 
the homogeneous case histories showed a 
higher average level of agreement among 
themselves and also as a group correlated 
higher with the judgments of the clinical psy- 
chologists. Probably student Ss have just as 
many, if not more, different bases and cri- 
teria for judging clinical material as do ex- 
perienced clinical Psychologists and the ex- 
perimental procedure of selecting clinical 
material that experienced judges using dis- 
similar judgmental criteria can agree upon 
also results in greater agreement among less 
experienced judges, 

The present study was designed solely to 
test whether the factor analytic procedure 
herein described would help in developing a 
homogeneous set i 


reliability of clinic 


al judgments gu tifi 
the ranking metho heed y 


Summary 


tion in judgment. Factor scores were aa 
mined for each case and 10 with the small 
intracase variance in factor scores selected 5 
a more homogeneous group. Undergradua 
student Ss (N = 43) then ranked for K 
justment level either the original 15 or 55 
selected 10 case histories. The student i 
ranking the 10 cases were shown to hara 
significantly higher average interjudge co 
lation and to correlate higher with the JU 
ments of the clinical psychologists. 
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The Relationship Between Measures of Individual 


and Mass 


Empathy 
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An : , 

ca Ba important problem in clini- 
ions is the Pa in all interpersonal rela- 
Problem on s lerstanding of other persons, a 
rapidly gr w hich there recently has been a 
ably e literature, summarized quite 
ods m | (6). Among the various meth- 
judge peop] by him to measure the ability to 
Chavior has been that of prediction of 
Scribes this life-history data. As Taft de- 
QWaintance method, the judge has some ac- 
Subject eat or is given data about the 
Jects perfo he is required to predict the sub- 
1s aca poe various test items oF 

s to attitude and personality tests, 


t to predi 
life shes ict certain aspects of the subject’s 
een y. These are the tests which have 


] 
hee “empathy” tests. 

Cen a her id of these instruments have 
Pioneer fak ped, as Taft indicates. One of the 
Mond (1) aes: in this field is that of Dy- 
ach i Peo: test is made up of 4 parts, 
Part, the eae the same 6 items. In the first 
ol A, Sipai ividual is asked to rate himself 
Sties, In i scale on each of 6 character- 
Some other i second part he is asked to rate 
i e ra arnal on the same 6 traits. 
“dividual a, he is required to rate the other 

Enar: he believes this other would 
Self as he thi In the fourth, he must rate him- 
qe word inks the other would rate him. In 

Widuals T according to Dymond, if two in- 
podat TAR B, were being tested for their 

€ as follows: each other, the procedure woul 
> Part i 

rs i rates himself (A). 
3. A ae B as he (A) sees him. 
A himsel B as he thinks B wou 

s ae i (A) as he thinks B would 


Id rate 


of New Mexico 


B. Part 1. B rates himself (B). 
2. B rates A as he (B) sees him. 
3. B rates A as he thinks A would rate 


himself. 
4. B rates himself (B) as he thinks A would 


rate him. 

Therefore, a measure of A’s empathic abil- 
ity is derived by calculating how closely his 
predictions of B’s rating (A3 and A4) corre- 
spond with B’s actual ratings (B1 and B2). 
Similarly, a measure of B’s empathy with A 
is obtained by calculating how closely his pre- 
dictions of A’s ratings (B3 and B4) corre- 
spond to A’s actual ratings (Al and A2). 
Since each rating is made on a 5-point scale, 
the test is scored in terms of the total num- 
he individual is in error in his 
s is called the deviation score. 
ed as items in all 4 parts of 
confidence; superior-inferior ; 
jendly-unfriendly; leader- 


termed a meas- 
in that the 
dictions concern- 
words, ac- 


If into the t 
ther person, 
or to emph 


as an individual. 5 
Now, another approach to the ability to 
rmed that of 


judge other people may þe te a 
“mass empathy.” In this approach, the judge 


is required to predict the combined response 
of a group of individuals, rather than those 
of a single person. Taft (6) cites at least 10 
studies in which this method was used, but 
does not include that of Norman and Ains- 
worth (5), owing to the comparative recency 
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of the latter study. These investigators de- 
veloped a procedure for the measurement of 
mass empathy which involved administration 
of a personality inventory (the Guilford- 
Martin Inventory of Factors GAMIN) in 
two forms. The first form was given in the 
usual way with the subject answering for him- 
self. (An exception to the regular adminis- 
tration was the elimination of the “don’t 
know” alternative, so that subjects were 
forced to answer “Yes” or “No.”) Two weeks 
following the presentation of the first test, a 
second form was given to the subjects. The 
same questions were used, except that instead 
of answering for themselves, the subjects were 
required to answer the questions as they 
thought most other people of their own age 
and sex would answer them. For example, 
question 7 on the original test reads, “Do 
you express such emotions as delight, sorrow, 
anger, and the like readily?” On the second 
form this question was changed to read, “Do 
you think most people of your own age and 
sex express such emotions as delight, sorrow, 
anger, and the like readily?” Because it was 
felt there would be more uncertainty in an- 
swering questions for others, the question or 


“don’t know” alternative was omitted from 
both forms. 


The mass empath 
lows. If 51 per cent 
swered in a given directi x 


(51%) had said about themse 
ject’s mass empathy score is sim 
number of points so earned. 


or personality test, there is the spurious effect 
of projection.’ They ask 


1 The use of the term “projection” 


by Hastorf and 
Bender (3) differs from that of 


Norman and Ains- 
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prediction being made is closer to the E 
sponses of the person predicted for (e 
pathy), or to the predictor’s own score Er 
jection). They therefore attempted to mi 
the factor of projection from that of empa A 
in a study of their own, a process ae 
plished by taking the difference ne i 
empathy and the projection scores. aa 
their results, they emphasize the fact ther 
part of the successful prediction of wo: 
person's responses may be due to projec aa 
rather than empathy, and that a refined ie 
ure of empathic ability might approxime 
more adequately the psychological apen 
empathy. In the present study, an atte 108 
was made to account for this factor of P 
jection, as will be indicated later on. res 

The basic problem investigated in the Pe 
ent study was to explore the relationships 7 
tween the Dymond test of individual : 
pathy and the Norman-Ainsworth appr? 
to measurement of mass empathy, using 
raw and refined measures. 


Subjects and Procedure 


Subjects used for this study were 47 
bers of a social fraternity at The un 
of New Mexico. These men were diviie 11; 
5 groups. Three groups, consisting whe of 
and 10 individuals, respectively, consist oy 
active members of 1 year membership 5 
more; and 2 groups, of 9 and 6 maw 3 
each, were composed of newly initiated 2 

e 
; 0 


mem 
rsit 
(2 to 


e 
bers. Selection in all groups was ett 
random choice. Each member was ins up $ 
to rate every other member of the g!0 


1 Dy 
which he belonged on all scales of the gist? 
mond test. Since groups of different “|p. 


were used, an average empathy score WaS 
tained for each subject. e al 

For the mass empathy testing, the sar ag 
Subjects were given the GAMIN twice f of 
ing to the procedure described above- raced 
der that greater confidence might be Fe ut 
in the “51% criterion” obtained from t” jo” 
of the GAMIN, the data of Norman an 
ae 


5 
it ye 
worth (5) in their study. The former refer a i 
simple attribution of one’s own traits to ot ie 


ve in oe eno e 
atter defined it Operationally in its m desit? g 
sych lyti ial of un er?! 
Psychoanalytica] sense, namely, denial o hi 


canes 0 
traits in oneself and attribution of them t° og # | 
| 


a 


ot 


a adher? 
or defense projection, In this study, we 
Bender and Hastorf’s usage. 


a 
” i 


Individual and Mass Empathy 81 


Ww 5 . 
oe) a byes previous study were in- 
Since their ij h the data of the present study. 
increased V Pei 74, and ours was 47, the 
were based i 121 on which the percentages 
Tt was fou Pn obyinnsly more satisfactory. 
since out i: that this procedure was justified, 
Were 174 o 186 items on the GAMIN, there 
significant P per cent which yielded no 
As eri erences between the two studies. 
Projection tonen above, the factor of simple 
tional ren aai enters into the opera- 
according rie! of empathy used in this study 
ender Sy rae reasoning of Hastorf and 
ecided to ollowing their suggestion, it was 
both tests ee to isolate projection on 
empathy s SAUS WE secured 3 measures—taw 
obtaining ape and refined empathy. In 
e Dymond refined measure of empathy for 
Used: For ez test, the following method was 
Was taken = individual rated, the difference 
at 3 of th etween the score obtained on 
thee ee (wherein A rated B as he 
on Part 2 would rate himself) and the score 
indie eee A rated B as he, A, saw 
(Wherein ry , the score obtained on Part 4 
Would at rated himself as he thought B 
store tite! him) was subtracted from the 
‘self pas on Part 1 (wherein A rated 
Subjects. he total projection score for all 
“Mpathy was subtracted from the total raw 
divideq AR and this difference in score, 
Viduals y course by the number of indi- 
Vidua Ps, gave an average refined indi- 
refine eee score for each subject. The 
à similar fa empathy score was obtained in 
rom the apa i.e., by subtracting one point 
Vidua ees empathy score every time an in- 
nswered an item about “most other 


People 
e” t 1 
about Binet way he answered the item 


Results 


The a: 
ent S different variables explored in the pres- 
Siven ne intercorrelated, with results as 
“ntainin able 1. The latter part of Table 1, 
ebro 8 the correlations between the two 


ach 
es to the measurement of empathy, 
rela- 


e all 


. Cates 
tionsp; >, COnclusively that there is nO 


Ons 
x t 2p petween them. The coefficients a 
ee oity of zero and do not differ sig- 
‘ sec that figure. However, the Dy- 
elatio Widual Empathy Test reveals a high 


nshi 
ip between raw and refined em- 


Table 1 


Correlations Between Various Measures of 
Empathy and Projection 


Dymond Individual Empathy Test 
Raw and Refined Empathy 
Raw Empathy and Projection 13 


Refined Empathy and Projection — Aq 
Mass Empathy Test 

Raw and Refined Empathy —.21 

Raw Empathy and Projection .86** 

Refined Empathy and Projection —.69** 
Individual vs. Mass Empathy Tests 

Raw and Raw Empathy .07 

Refined and Refined Empathy —.06 

—.10 


Projection and Projection 


* Significant at 1% level. 


pathy, with the factor of projection entering 
somewhat into the raw empathy score. It is 
probably advisable, though, that the projec- 
tion variable be eliminated with future use of 
this test, since the correlation is significantly 
negative (— 47) between the refined empathy 
score and the projection score. With the Mass 
Empathy Test, on the other hand, the projec- 
tion variable is a serious one with which to 
contend, since the relationship between it and 
raw empathy is very high (7 of .86); the cor- 


relation between it and refined empathy is 


also high, the ” being — -69. The resulting re- 
lationship between raw and refined empathy 


tends to be a negative 21, although this is not 


statistically significant. 
Discussion 


The findings of the presen 
the lack of relationship between the measures 
of individual and mass empathy are m agree- 
ment with results of Hall and Bell (2) who 

into the agreement between the Dy- 
Kerr Empathy Test (4). 
The latter is also a purported measure of mass 
empathy, requiring l ) rank 
14 common types 
their popularity amo) 
rank 15 magazines in or 
least paid circulation; and 
of an individual 40 years of age and rank 10 


experiences from most to least annoying. Hall 
and Bell feel that their test aims to measure 
the individual’s ability to assume the hypo- 
thetical average person’s structural field, i.e., 


t study regarding 
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somehow to combine a series of “others’ ” in- 
dividual fields into „an average. (The mass 
empathy approach: used here seems to do 
very much the same when the subject is asked 


the low correla- 
tion between the mass approach and the in- 
ivi has made the 
terms (after 
Wallin) analytic and nonanalytic judgments, 
He says, “In analytic judgments, the judge 
(J) is required to conceptualize, and often to 
of the sub- 


traits, Writing Personality descriptions, and 
the 


| 


ess of inference,” the subject, without a frat 
of reference of a Particular person, AS ce 
likely to project his own feelings and all 
tudes into his answers. Hence the very aie 
r between raw and refined empathy and 
very high r of .86 between raw empathy am 
rojection. «pal 
i A any case, Hastorf and Bender’s cote 
(3) is well taken, for the projection E 
seems to enter significantly in both tests, 
much greater degree, to be sure, in the m 
approach than in the individua] approach. 


Summary and Conclusions 


Using 47 members of a social fraternity © 
subjects, two measures of empathy were i 
related. These were the Dymond Tes Ly: 
measure of individual empathy, and a Oot 
cedure devised by Norman and Ainswor Si 4 
the measurement of mass empathy. In vie 
8eneral criticism of these approaches in tjon: 
they did not isolate the factor of projec th 
there were three scores derived from ” s 
measures—raw empathy, projection, an 
fined empathy. Correlations were about athy 
between the individual and mass emh 
measures for all these variables, but 7 
cant correlations were obtained between ) | 


oo 


+», do 
variables within the Measures, Projection usl¥ 
enter as a factor in both tests, more a 
in the mass approach than in the indiv oft 
approach, Probably because there are ip 
inferential 


judgments in the former tha” 
the latter, 
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hist "ations in symptomatology, previous 
iagnosed ultimate prognosis of patients 
er of i cco ain have led a num- 
term itself eS to question whether the 
Or examp] as any fixed meaning. Fenichel, 
een ay remarks “Occasionally it has 
entation js a whether a comprehensive ori- 
verse schiz Possible at all and whether the di- 
thin Ophrenic phenomena actually have 
Phrenjg? E in common. The label ‘schizo- 
'S not eve applied to so many things that it 
nosis. Of value for the purpose of prog- 
definite |” Certainly, ‘schizophrenia’ is not a 
races a wha Sica] entity, but rather em- 
orde ole group of diseases” (2, p. 415). 
Precis to lend schizophrenic diagnoses 
Ptomat e amotai gee in terms of etiology, 
Vestigator ology, and prognosis, various in- 
all diagn 5 have attempted to divide the over- 
80ries, Thee of schizophrenia into subcate- 
with whict, number of differentiated subtypes 
from they have emerged have ranged 
urged p e “process”—“reactive” dichotomy 
tional is Some investigators, to the tradi- 
catatonic r subtypes of simple, hebephrenic, 
“ations gad paranoid. None of these classi- 
atology, h ased in large measure on symptom- 
tice, ithe, Proved highly effective in prac- 
(a). S% in terms of prediction or contro 
of Recently, 
. existing 
Clates tg i 
aimed at di 
empiric, 


. Baseq on 
Paper presented at the annual meet- 


ing of 
£ the . kacs 
Chicago, inte eee Psychological Association, 


E 
dissatisfaction with the usefulness 
approaches led Beck and his asso- 
onduct an interdisciplinary study 

erentiating schizophrenic cases 0n 
al basis—principally, as he says, in 


‘for assignment 


83 


terms of variations in “ego functioning.” A 
preliminary outline of possible variations in 
psychological defenses and ego functions was 
prepared by a number of psychiatrists under 
Grinker. This outline was then broken down 
by Stephenson into 120 separate items de- 
scriptive of personality functioning. Q sorts 
of these items were then made by psycholo- 
gists and psychiatrists for groups of outpa- 
tients previously diagnosed as schizophrenic. 
The psychiatrists (referred to as P in this 
study) sorted the items on the basis of clini- 
cal interviews with the patients, the psycholo- 
gists (referred to as A and B) on the basis 
of individual Rorschach protocols. Each pa- 
tient was rated by one psychiatrist and at 
least one, usually two, psychologists. All of 
the sorts for a group of patients were then 
intercorrelated and a factor analysis made of 


the resulting matrix. 


ee such analyses were made. Initially Beck and 
i seers began by rating 20 patients, 12 adults 
and 8 children. Since an jnordinately large correla- 
tion matrix would have resulted had an attempt 
been made to factor-analyze the total group, it was 
subdivided “into an ‘agreement group, ie. one in 
which psychiatrists and Rorschach test investigators 
showed agreement jn judging the patients; and a 
‘disagreement’ group” (1, P. 71). Apparently, factor 
analyses of the jntercorrelations between raters with 


-dividual patients were used as the basis 
DIE ee the agreement or disagreement 
group. Presumably when all the raters had similar 
factor loadings on a patient, he was assigned to the 
agreement group. When they did not, he was as- 
signed to the disagreement group. The exact degree 
of similarity required for assignment to the agree- 
ment group could not be ascertained from the in- 
formation available. However, real questions arise in 
this connection, since, as Shaffer points out, hai 
the psychiatrists and psychologists seemed in better 


84 


agreement on 3 of the 8 ‘disagreement’ cases than on 
3 of the 12 ‘agreement’ ones” (3, p. 472). At any 
rate, the division was made primarily for purposes 
of convenience in handling the data. In addition to 
these two groups, a third group of 20 schizophrenic 
children, some of them repeaters from the first two 
groups, was also studied. 


On the basis of these three analyses, Beck 
and his collaborators derived five factors. 
These factors, then, led them to define, “by 
their juxtaposition,” six types or classes of 
schizophrenic cases (1, p. 226). 


The Present Problem 


While we are not concerned here with the 
merits of Q technique, we question the meth- 
odology employed in obtaining Beck’s results, 
and feel that it casts serious doubts on the 
validity of his conclusions. In the case of 
each of the above analyses, the group correla- 
tion matrix consisted of X individual ratings 
of Y patients. Thus, each correlation coeffi- 
cient represents a combination of rater and 
patient characteristics. In other words, the 
amount of variance the correlation accounts 
for is distributed between the two in indeter- 
minate amounts. Therefore, when this corre- 
lation matrix is factor-analyzed it is virtually 
impossible to tell to what extent the factors 
represent raters or patients. 


Procedure 
Another method of analysis might separate 
the effects of raters and patients. 
that from Beck’s over-all matrix we 
the individual intercorrelation matri 
the three raters, and factor them sep 
If Beck’s factors are in fact due prim 


Table 1 
Rotated Factor Matrix, Rater A 


Assume 

extract 
ces for 
arately. 
arily to 


Subject Factor Factor Factor 
numbert I II II 
3 .82 
5 17 
13 49 41 
14 -50 44 
8 74 
19 -74 
4 Al 54 


Note.—Loadings with an al 
omitted. 


t These numbers correspond to the numbers used by Beck, 


bsolute value under .40 are 


John J. Conger, William L. Sawrey, and Leonard F. Krause 


Table 2 
Rotated Factor Matrix, Rater B 
Subject Factor Factor ge 
numbert I II 
3 86 
5 76 
5 a 
13 60 eo 
14 45 
1 .87 
9 83 
11 .80 
12 87 
15 65 
8 88 
19 Ti äi 
4 61 . 


40 

= jer * 
Note.—Loadings with an absolute value und eck 
omitted. B 


"i d bY 
t These numbers correspond to the numbers use 


rge 
patient differences, we should then em P 
with three quite similar factor patterns: tate 
was done, in each case attempting t0 simi 
toward simple structure in a fashion a5 > 
lar to Beck’s as possible. 


Results and Interpretation 2 


Agreement group. From his analysis : ded 
over-all agreement group, Beck ning 
that there emerged four factors, -5 
three schizophrenic types, S-1, S-2, a” whe? 
A somewhat different picture emerge atric 
we analyzed each of the three raters’ ™ ix f 
separately. Rater A’s rotated factor ‘oe fac’ 
shown in Table 1. Assuming an absolu fol 
tor loading of .40 or larger to be i cleat 
enough to help identify a factor, it pacto | 
that individuals 8, 19, and 4 identify ffyd 
I. Similarly, Factor II is identified bY 
viduals 3, 5, 13, 14, and 4, and Factor apn o 
individuals 13 and 14. After extracti one 
these three factors, it can be seen tHe one” 
of the remaining loadings are great i 
to account for further factors. a A 

The corresponding matrix for Rat oi 
shown in Table 2. In this case, Fact. 8, 
} 


viduals 3, 5, 13, and 14, The only rem 
factor, Factor III, is identified by indi 
13, 14, and 4, 3 et 
Rater P’s matrix is shown in Table 3 F 
Factor I is identified by individuals 1» | 
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Table 3 
Rotated Factor Matrix, Rater P 


Subj = 
pec Factor Factor Factor Factor 
il I IL 1I IV 
: 74 
13 84 —.42 
14 -65 B 
: 69 3 _63 
1 Pi 
12 7 68 
1 j 
; -63 =53 
19 72 a 
4 di Si 
N — z, 
cte-—Loadings with an absolute value under .40 are 


omitted. 
hese 
numbers correspond to the numbers used by Beck. 


le 
hee $, and 4. Similarly Factor TI is identi- 
Y individuals 3, 5, 13, 15, and 19. Fac- 


tor ER 

Slt is identified by individuals 13 and 14- 

identin’ the remaining factor, Factor IV, is 
ed by individuals 5 and 1. 


maties t are these individual factor 
there Should be immediately apparent that 
atious ists some disagreement between the 
(and è raters as to the number of factors 
tYpes ee the possible number of 

schizophrenia) present in this popu- 


85 


lation. Raters A and B, for example, emerge 
with only three, while Rater *P finds four. 
Furthermore, there appear to be interrater 
differences in terms of the individuals identi- 
fied by apparently parallel factors. The corre- 
sponding factor patterns for each of the three 
raters are presented in Table 4. 

As may be seen, there is only fair agree- 
ment among all three raters in defining Fac- 
tor II. They all assign moderate or high load- 
ings on this factor to individuals 3, 5, and 
13, and negligible loadings to individual 8. 
Furthermore, Raters B and P agree in assign- 
ing negligible loadings to individuals 1, 9, 11, 
and 12 (these individuals were not rated by 
Rater A); however, they disagree on indi- 
vidual 15. In addition, the three raters dis- 
agree on individuals 14, 19, and 4. Raters A 
and B, for example, assign a moderate posi- 
tive loading to individual 14, while Rater P 
gives him a negligible loading. While Raters 
A and B agree in assigning a negligible load- 
ing to individual 19, Rater P gives him a 
moderate positive loading. In the case of in- 
dividual 4, Raters B and P agree in assigning 
him a negligible loading, while Rater A gives 
him a moderate positive loading. 

On Factor I, there is somewhat better agree- 
ment than on Factor II. All three raters agree 
that individuals 3, 5, 15, and 14 have negli- 
gible loadings on this factor and that indi- 


Table 4 


for the “Agreement” Group 


Combined Factor Patterns of all Raters 
IL Factor II Factor IV 
Subject Factor I Factor > 
Umber} A B P Ai B P A B P - 
: 7 0 0 0 
9 7 ai 
5 0 0 0 8 Hl , 9 i 
13 0 0 0 8 s ; A 7 5 0 
14 ? o 0 P i 4 6 6 2 
1 za S ; * 0 0 A i i 0 
9 a * 0 0 : 3 5 0 
11 5 8 6 i o* 6 z 0 0 0 
12 a 8 6 j ü 0 : 7 i o 
15 i 9 7 + = : 0 0 ° 
19 7 8 9 o 0 ? o 3 ð : 
0 
s Le | t o ð o -4 0 0 
s igi ingle significant figure and with the decimal points 
mt Digits i ay aca dings expressed to a St 
TRitse Loading below an abso value factor loadhgicated 25 0 
he ibj, ers correspond to the numbers used by Beck. 


Subjects were not rated by A. 
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viduals 8 and 4 have moderate to high posi- 
tive loadings.“In addition, Raters B and P 
agree in assigning positive loadings to indi- 
viduals 1, 9, 11, 12, and 15. In the case of 
individual 19, however, Raters A and B dis- 
agree strongly with Rater P. While A and B 
both assign him a high positive loading, P 
gives him a negligible loading. Whether there 
would have been additional agreement or dis- 
agreement if Rater A had rated all subjects, 
we do not know. 

On Factor III, all three raters agree in as- 
signing negligible loadings to individuals 3; 
5, 8, and 19, and moderate positive loadings 
to individuals 13 and 14. Raters B and P 
agree in assigning negligible loadings to indi- 
viduals 1, 9, 11, 12, and 15. However, while 
Raters A and P assign negligible loadings to 
individual 4, Rater B assigns him a moderate 
negative loading. 

When the above three factors are removed 
from the various factor matrices, the situation 
becomes more complicated. Raters A and B 
have, in effect, no Factor IV; that is, on no 
individual do they have any remaining fac- 
tor loadings above -.40. Rater P has a fourth 
factor, identified negatively by individuals 5 
and 1. 

The above comparisons make it clear that 
there is disagreement between the various 
raters both as to the number of factors pres- 
ent in this patient population, and also as 
to which persons identify apparently parallel 
factors. In his analysis of the over-all agree- 
ment intercorrelation matrix, Beck obtained 
four factors. Since in our analysis of the in- 
dividual rater’s matrices, Rater P js 
one having a fourth factor, 
Beck’s fourth factor was prob 
disagreement among raters a 
of raters and individuals. 

It is also possible to view Table 4 in terms 
of the amount of rater agreement as to the 
factors characterizing each patient. For ex- 
ample, it can be seen that all raters agree 
that individual 3 is characterized strongly by 
Factor II, and not by Factor I or II. On 
the other hand, there is relatively poor rater 
agreement as to the factors characterizing in- 
dividual 4. Raters B and P agree that indi- 
vidual 4 has negligible loadings on Factor II, 
Rater A, however, gives him a moderate posi- 


the only 
it appears that 
ably a result of 
nd confounding 
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tive loading on this factor. On Factor m 
Raters A and P give this patient neglig! i 
loadings, while Rater B gives him a modera 
negative loading. All agree that Factor 
characterizes this patient. Rater P at 
individual 4 a negligible loading on his 
or IV. z 
i Let us first consider the seven patients 5 
whom ratings by all three judges were E 
able. Since three factors were extracted, ie 
are 21 possible instances in which a A 
raters may agree. However, in only cuts 
these instances does such agreement E are 
even when all positive loadings above 4 from 
considered identical and when anything 
— 39 to + .39 is considered to be zero a 
table. For the remaining five patiens d 
were rated by only two raters, there a con 
possible instances of agreement. If wageni 
sider all positive loadings above .40 as} a 
cal for our purposes, there are 14 inst® 
of agreement. mong 
In our opinion, the limited agreement 4 ot 
raters shown in the above analyses 40° | 
justify Beck’s contention that clear-cut 
tors, based on patient differences, emerge 
his analysis of the “agreement” peat 
Disagreement group. It is somewha' o the 
cult to interpret Beck’s statements aS analy” 
factors which he feels emerge from an oint: 
sis of his disagreement group. At ee t 
he states that four factors emerge, ÞU nd / 
of these are the same Factors II, II, 4 


Table 5 


the 
Combined Factor Patterns of all Raters for 


“Disagreement” Group 
f 


pact? 
Factor Factor L 
IL 
Subject p 
number? A B P A B P 0 
2 67 5 o 0 0 : 
6 0 0 6 0-7 0 4 
7 5 0 0 0 o 5 “a 
10 a % 5 0 0 0 0 
16 0 0 0 7 ay b 0 
17 OG 0 5 = V O 5 
18 7% % 0 o0 E E 
20 EE E O 0 0 ‘i ng} 


Joa im 

or Osce 
Note.—Digits in the above table indicate faethe a0 iY 
expressed to a single significant figure and wi f 


e , 
points omitted, Loadings below an absolute val! pect 
indicated as 0. 


d bY 
These numbers correspond to the numbers us“ 


than a ee a 


e. 
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z = cap ee group. We are somewhat at 
conclu to determine how he arrived at this 
ness sion. Since he included in his disagree- 
beled “tes factor matrix three inputs la- 
these a , 5-2, and S-3, it would appear that 
Ment snes somehow obtained from his agree- 
ables a yas; and included as reference vari- 
these in owever, if this were actually the case, 
Ors in big should load up on different fac- 
Oweve he disagreement analysis. Actually, 
ment e they all load up on Beck’s disagree- 
problem: ctor II. Because of these and similar 
mentin S, we do not feel capable of com- 
tion § on Beck’s analysis and interpreta- 
of the disagreement group. 

ae o? we were again able to extract and 
matrices e individual rater’s intercorrelation 
BOUD, From the case of the agreement 
a ke a the results, the factor patterns 
e Shy Table 5 were prepared. As may 
ater B Rater A emerges with two factors, 
VO fact with three factors, and Rater P with 
™phasi ors. It seems to us that these data 
from ri the distortions that may result 
Matrix oe an over-all intercorrelation 
“Or whi] von confounds raters and patients. 
More th e no individual rater emerges with 
actors A three factors, Beck isolated four 
Seem pes his over-all analysis. It does not 
further uitful to investigate rater agreement 
lected o since this group was explicitly sè- 
n the basis of disagreement. However, 


one again wonders about Beck’s criteria for 
disagreement since all raters were in agree- 
ment as to the factor loadings of individuals 
2 and 16. 

The data from Beck’s analysis of his third 
group of 20 schizophrenic children are not 
available, and consequently cannot be com- 
mented upon. 


Summary 


In the present analysis we have demon- 
strated (a) that there is disagreement among 
raters as to the number of factors present in 
this population of patients, and (b) that 
there is also disagreement as to which per- 
sons identify apparently parallel factors. 

In light of this evidence of interrater un- 
reliability, we do not feel that Beck is justi- 
fied in his conclusions as to the factors, and 
consequently the schizophrenic types which 
characterize his population. 
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A Reply to the Reanalysis of Beck's 
“Six Schizophrenias” 


William Stephenson 


Greenwich, 


The paper by Conger, Sawrey, and Krause 
(2) reanalyzes data in Beck’s monograph 
(1) and questions the initial analysis on the 
ground that it involves a combination of rater 
and patient variances in unknown or unknow- 
able proportions. Their own alternative analy- 
sis results, in one case, in agreement being 
shown in 15 out of 21 instances, and in an- 
other case in 14 out of 15. They conclude 
that this is “limited” agreement, and evidence 
of “interrater unreliability.” Having regard to 
the complex matter involved, the present au- 
thor wishes that he could be as successful on 
the racecourse as Beck’s colleagues were in 
the clinic. Other considerations suggest, too, 
that the sounder conclusion, even when the 
data are analyzed in a different way, is 
that considerable evidence is forthcoming for 
Beck’s hypotheses, 

The point at issue is as follows. The re- 
analysis brings into focus rater specificities 
rather than factors of more general range. If 
a matrix is factored for a particular Rater A, 
factors are apt to involve his specificities, due 
to his greater or lesser training and the like; 
and while it may be of interest to study such 
factors, they are unlikely to be of immediate 
interest or necessarily relevant to one’s more 
general theoretical questions, Clearly, in this 
connection, the reanalysis involves itself only 
in certain factors, and not in their factor- 
arrays, without which Conger, Sawrey, and 
Krause are working completely in the dark. 
Beck, however, was working in the full day- 
light of his factor-arrays, and not with mere 
factors as such or the possibility of specifici- 
ties. His concern was with the general ques- 
tion as to whether different psychologists and 
psychiatrists, over a range of different pa- 


Connecticut 


+a] in 
tients, could provide factors of theoretical : 
terest—the latter matters being judge 
the factor-arrays at issue. The andomi 
of raters and patients involves the Soaijliat 
logic with which agronomists are m e 
when, in their experiments, they divide t dif 
into plots in such a way as to level ike in 
ferences of fertility, shadow, and the alcas 
different parts of the field. In the clinic eith! 
we seek to cancel out the specificities © that 
raters or patients, with the firm hopê 
generality is the more likely that way: 
The trouble, if I may say so, is t rat ges 
all too easy to slip into categorical me ws 
in factor studies. To talk of “interra uch * 
reliability” is to involve oneself m = {0 
mistake. It would have been quite © aQ 
provide Beck and his colleagues mone! 
sample which would result in one tim’ 
per cent agreement about patients — To 
but about quite unimportant mattei rest 
reach a factor of real psychological det Be 
(as judged by the factor-array), wre, ew 
complex conditions of Beck’s Q sampl@ ei 
if the loadings are relatively small a” 
deployment over different raters 50 
patchy, may be altogether far more ae 4 
than to reach a factor with high loadi wou! 
everyone concerned. The latter facto! 5 w 
probably only deal with the obviowd by 
banal, or worse. With the Q sample r theo; 
Beck, involving as it does some comple as P 
retical matters, the wonder is (as oe att) 
author is concerned) that there waster 
agreement between psychologists the an th 
and with the psychiatrists, rather t 
the agreement is “limited.” Jaf 
The same kind of categorical slip i§ 
as well, in the critical remarks made 
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fore? 


re 
Ce 


Reply to Reanalysis of “Six Schizophrenics” 89 


Table 1 


Tnterc = 
correlations and Factor Loadings for Two Patients 


Patient 1 
= Factor 
ater 1 2 3 4 loadings 
: Psychiatrist 16 16 16 40 
A p chologist A 16.16 ‘40 
$ Psychologist B i 16 40 
~ Psychologist C l 40 
Patient 2 
Factor 
loadings 
: Rater 1 2 3 4 I w 
TER 
a parchiatrist 25 25 .25 50 00 
3. pa cPologist A 33 61 50 60 
4, p? chologist B 5 a5 50 -00 
Sychologist C ` “50 ‘60 


auth 
way in he by Shaffer earlier (3), about the 
into gn Vhich Beck divided his 20 patients 
group, agreement”? and a “disagreement” 
Y size of ined not 
Critics te correlation (a criterion that the 
Patability ee 7 to recommend) but by com- 
ill thet, of factors. The examples in Table 1 
e € the difference clear. 
Smaller Fig correlation for Patient 1 is 
n agreem an for Patient 2 but the raters ate 
Other Die about the factor at issue; in the 
Parently ient, however, though they are ap- 
differ ap, in agreement about one factor, they 
the sity Out the other. It is easy to see that 
that ten in the latter case could be such 
3 deca ee could agree about Factor I by 
respondi t less than 0.40, with Factor TI cor- 
thing “ark higher for all four raters. Every- 
nite depend upon how these Patients 1 
tients by Pear in a table including other pê- 
t well. The assumption is reasonable, 
» that matters are likely to be straight- 


T 5 
hese categories were determ 


OWeve 


forward for Patient 1, although, with other 
patients and raters in the matrix, a complex 
factor situation is still likely, whereas for Pa- 
tient 2 matters are already complicated. It 
was with such considerations in mind, then, 
and not the mere size of intercorrelations, 
that Beck’s patients were divided into two 
categories for convenience. 

It is well known that multiple factor condi- 
tions are permissive (4). An appropriate fac- 
tor methodology, therefore, is to use factor 
analysis to answer psychological questions, in 
a deductive rather than an inductive setting. 
In Beck’s case the concern was with the ques- 
tion whether ratings were, or were not, con- 
sistent with a certain theoretical position. The 
same data might be consistent with other 
theoretical positions as well, but this would 
be a matter for separate consideration. One 
should not think of such factor analysis, 
therefore, as a producer of facts for induc- 
tive regard (which is still another categorical 
mistake), but as a reproducer of facts, from 
a deductive standpoint. 

We see, then, in the short space of a single 
paper, several sources of categorical assump- 
tion, against which Q method is always di- 
rected. Beck’s initial analysis made no such 
mistakes, and is clearly on sound lines. 
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Reply to Dr. Stephenson 


John J. Conger, William L. Sawrey 


University of Colorado School oj Medicine 


and Leonard F. Krause 


University of Denver 


While we do not wish to belabor discussion 
of the methodological differences existing be- 
tween Stephenson (4) and ourselves (2), we 
do feel that several specific points in his reply 
require comment. In the first place, Stephen- 
son remarks that even with our method of re- 
analyzing Beck’s data, we emerge, in the one 
case, with 15 out of 21 possible instances of 
Tater agreement (when three raters were 
used) and, in another case, with 14 out of 15 
possible instances of agreement (when only 
two raters were used). Two points should be 
stressed in this connection. First, agreement 
of this magnitude occurs only when all posi- 
tive loadings above .40 are considered identi- 
cal and when anything from minus .39 to 
plus .39 is considered to be zero, i.e., also 
identical, Second, this amount of agreement 
obtains only for Beck’s “agreement” group, 
which was presumably preselected for inter- 
rater agreement. When the same criteria for 
rater agreement are applied to the two factors 
which all raters had in Beck’s “disagreement” 
group, agreement occurs in only 6 out of 16 
possible instances, as Table 5 of our paper 
(2) demonstrates, 

Stephenson remarks that he wishes he could 
do as well at the race track as Beck and his 
colleagues have done in the clinic. In this con- 
nection, we would like to make it clear that 
we have only admiration for the clinical skills 
displayed by Beck and his colleagues, and for 
their ingenuity in attempting to conceptualize 
the problem of schizophrenia in dynamically 
more meaningful terms. Our concern here is 

not a clinical, but solely a methodological one, 
having to do specifically with the manner in 
which the data were analyzed. Parenthetically, 
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however, Stephenson’s race-track analogy ane 
not impress us as particularly relevant, sine 
in order to make visits to the race track m 
tremely profitable one need do only slightly 
better than chance. A similar degree of su 
cess in the clinic does not seem to be a Pat 
ticularly desirable goal. t 
However, as Stephenson himself points ott 
the essential point of difference betwee? fe 
does not concern the extent of interra 
agreement in Beck’s data. It concerns, aa 
the theoretical necessity for such agreeing 
In Stephenson’s words, “To talk of interra is 
unreliability” in discussing factor studies 
to involve one’s self in a “categorical ne 
take.” We do not agree. As we think our 3 
analysis demonstrates, replicable findings fr 
factor analysis cannot be assured a. 
reasonable degree of interrater reliability ajf 
ists at the outset. Stephenson argues that ‘i 
a matrix is factored for a particular Ratet 
factors are apt to involve his specificities. e 
to his greater or lesser training and the We 
: - ” This may well be, and if so, genen 
ing from this rater’s findings would certa 
be misleading. That is why it is det 
to determine whether substantial ante þe- 
among a variety of raters can be obtaine 
fore making such generalizations. a in 
But the problem of generality canno "the 
our view, be solved simply by combining re- 
ratings of all raters across all patients, |, 
gardless of degree of agreement, into one jt- 
tercorrelation matrix, and then factoring ë 
Stephenson argues that from such a proc al 
one can derive factors of more “theoret t 
interest.” We are not entirely certain Na - 
Stephenson means by more theoretical i” 


Reply to Dr. 


fdent Ta are sure that one cannot be con- 
tors D this procedure, of deriving fac- 
define ee taken together in “factor-arrays,” 
an fn types of schizophrenia.” To take 
Aictor-anak example, it would be possible to 
the ratin y = the intercorrelation matrix of 
ne mi a Ob tone patient by twenty raters. 
from a = obtain a number of factors 
ut we aa actor arrays could be constructed. 
could be : not see how these factor arrays 
phrenia noi to define types of schizo- 
Spes of ie they might help to define 
ne Reng in their analysis, Beck and 
asa Gumi used a number of patients as well 
the epee, of raters, but it seems to us that 
e AT still applies. To the extent that 
iste eS te factory obtained will 
isa conside nd raters and patients. Where there 
ment (as erable degree of interrater disagree- 
gtoup). was the case in their disagreement 
Present i ight not new raters differ from the 
so Per even in rating the same patients? 
di erent ering their ratings might lead to 
Sets of Fro and consequently to new 
Dhrenj Fen al arrays, or “types of schizo- 
a.” Th : F 
festly un is, however, would be mani 
Sets of oe it seems to us, since both 
Ctived oe types would have been 
tephe the same patients. 
pl nson mentions several other exam- 


eS to ing; 
dark,» indicate that we “are working in the 
volve € points out that our reanalysis “in- 


hrs only in certain factors, and not 
© dire į eter arrays.” We fail to understand 
Humin implications of this for the degree of 
p licitly yo in which we are working. We ex- 
Were wo ognized that Beck and Stephenson 
i er with “factor arrays,” though 
nice it red to them as “factor patterns.” But 
these in a the factors themselves which le 
Positio Vestigators to define “by their justa- 
n?’ the factor arrays or types of schizo- 


reni 
al ne (1, p. 226), it seems to us only logi- 
e 


In th 


at changes in the factors woul 
t e changes in the arrays. 
o “the €ction with Stephenson’s r ; 
are Sewn of logic with which agronomists 
agrono iar,” we would like only to note that 
of the Mists in their work are aware not only 
We ales Stability of randomizing, with which 
Of course agree, but of the difficul- 
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ties in interpretation which may result from 
partial or complete confounding. This, we 
feel, is the primary problem in the present 
analysis. 

We are also charged with a “categorical 
slip,” as is Shaffer (3), in regard to the way 
in which Beck divided his patients into an 
“agreement”? and a “disagreement” group. 
We are accused of failing to understand that 
these categories “were determined not by size 
of correlation . . . but by comparability of 
factors”? 

We do not see how Stephenson could have 
arrived at this conclusion when we specifically 
stated, “Apparently, factor analyses of the 
intercorrelations between raters with respect 
to individual patients were used as a basis for 
e agreement or disagreement 
groups. Presumably when all the raters had 
similar factor loadings on a patient, he was 
assigned to the agreement group. When they 
did not he was assigned to the disagreement 
group” (1, pP- 2-3). We further stated that 
the exact degree of similarity required for as- 
signment to the agreement group could not 
be ascertained from the information available. 

We still feel this way, especially since in 
some instances in our analysis, the factor 
loadings were more comparable for the dis- 


agreement than for the agreement group. 
Consider, for example, the factor loadings at 
an 


ivi 19 in Table 4 of our paper, 
ma Ti As these tables show, 
le for Indi- 


assignment to th 


Individual 2 in 
the loadings were 
vidual 19, 4 member 0: 


Table 1 
for One Patient of the 


elations of Raters a 
Tnterogreement Group and One Patient of 
the Disagreement Group 
Intercorrelations 
a ee 
Patient and rater 1 2 3 
Patient 19 
1. Psychiatrist 01 a 
2 Psychologist A 4 
3. Psychologist B 
Patient 2 
1, Psychiatrist | 24 2 


2: Psychologist A 
3, Psychologist B 
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than for Individual 2, a member of the dis- 
agreement group. This does not seem surpris- 
ing in view of the obtained intercorrelation 
matrices of the three raters for these two pa- 
tients shown in Table 1 of the present Paper 
(data concerning Psychologist C, the fourth 
rater, were not included in Beck’s monograph 
and consequently cannot be included below). 
Although we are still uncertain as to the exact 
criteria for assignment to the agreement and 
disagreement groups, our more fundamental 
question concerns the usefulness of a method 
which fails to take into account correlation 
size, resulting in Categorizations such as the 
above. 

We would like to raise one final point. One 
of the reasons we did not proceed to analyze 
Beck’s disagreement group to the same ex- 
tent as the agreement group was that we 
could not understand his statement that in 
the disagreement group four factors emerged, 
but three of these are the same as Factors II, 
III, and IV of his agreement group. We could 
not see how this conclusion was reached. 
Since three inputs labelled S-1, S-2, and §-3 
were included in the disagreement-rotated 
factor matrix, presumably as reference vari- 


ables, it appeared to us that these were some- 
how obtained from the a 


If this were actually the case 


J. J. Conger, W. L. Sawrey, and L. F. Krause 


- y 
Factor II, we still do not understand, au 
Stephenson has not explained, the meaning 


of these inputs, or their relation, if any, y 


the agreement group factors. dis 

To summarize, despite other areas o e$ 
agreement between Stephenson and ourse! ies 
our basic and apparently irreconcilable pel ag 
of difference seem to involve differing ee 
as to the theoretical importance of any - 
reliability and confounding in a study suc to 
the present one. In Stephenson’s opinion, jve 
talk of interrater unreliability” is to DE 
one’s self in a “categorical mistake.” We ne 
ply cannot agree. In our opinion, it isa pe 
take to derive types of schizophrenia by p 
toring a matrix in which raters who disam 
substantially with one another are confoun 
with patients. 


Received November 15, 1955. 
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> The Effects of Perceptual Training on the 
Rorschach W and Z Scores’ 


Howard Leventhal 


University of North Carolina 


Alth 
Widely ey the Rorschach is now the most 
Psychology instrument in American clinical 
Ditically estat has little in the way of em- 
Number ka ablished foundations. Though a 
nized the n Rorschach workers have recog- 
remains th eed for normative data, there still 
or e cies of demonstrating the validity 
Mg the ya ulness of the hypotheses concern- 
eperine a ales being standardized. Direct 
est me ae with specific factors of the 
experiment. to have been neglected because 
© the ation, being analytical, is counter 
Schach en viewpoint held by many Ror- 
Stalt Se ty Bergmann’s discussion of ge- 
OWever = (4, pp. 450-451) makes clear, 
dtechaphy es the interrelationship of the 
unitary pe variables necessary to describing 4 
mentation rsonality does not preclude experi- 
oË variabl with any one or any combination 
Eis, es to discover the laws of these sub- 

he sions 

defined Ee of the W response has been 
acteristics “ee. in. terms of intellective char- 
The nimh orschach (18, p. 59) wrote that 
sidered meine of W responses is to be con- 
t e an indicator of the energy 
Positional ive activity, dependent on a dis- 
> P. 10) « of the subject.” Beck stated that 
Stee or hei The Rorschach test projects de- 
Whole ane ight of intelligence in tw factors- 
The Z s cepts (W) and organization (2):” 
Siustaura aa A F Beck (3, pp- 12-13) 1S 
Mtellige a more accurate representative of 
nce functioning per se,” as it considers 


1 
This 
= the Ea i was completed as & master’s thesis 
ended to D rsity of North Carolina. Thanks aF¢ ex- 
rs. W. Grant Dahlstrom, June E. Chance, 


rie Or 
Criticism, S. Welsh for their invaluable advice and 


intermediate values of organizati i 

ganization missed b 
W. He feels that the Z scores “vary oily 
as the intelligence of S.” 


Previous Studies with W and Z 


If W and Z scores can be meaningfully in- 
terpreted as measures of intelligence, it should 
be possible to demonstrate both their validity 
and reliability. Any valid measure of intelli- 
gence should be reliable. Thus, W and Z, as 
indices of intelligence, should not be unduly 
influenced by extraneous events like small 
amounts of training or slight emotional and 
attitudinal shifts. Since consistent results have 
not been obtained from correlational studies 
investigating the relationship of Rorschach W 
and Z to intelligence, experimental research 
directed toward locating possible variables in- 
fluencing the variability © W and Z scores 
might provide clues as to why these scores do 
not correlate more highly with intelligence. 
Among the factors that influence W and Z re- 
sponses are: Stress has been found to reduce 

(7). Examiner differences and 
e significant changes in W % 
(15). W responses increase in a social situa- 


some set seems to be of im- 
iments have at- 


f experim! 
influence by inducing 


subjects and measuring dif- 
ferences in responses. These sets have been 
manipulated by asking subjects to give “good” 

different occasions. No 


and “bad” records on 
changes in the record in W, and high intertest 


correlations, are reported in two instances (9, 
10), while low intertest correlations are re- 
ported in another (5). Instructions to pay at- 
tention to certain areas of the blot (12) pro- 


portance, 
tempted t 
various sets in 
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duced significant changes in W, as did hearing 
at a lecture that intelligent people see W (1). 
Even looking at colored advertisements before 
taking the Rorschach increased the number 
of responses (17). Keyes (13), in a more 
direct attack on this problem, treated four 
groups as follows: 1, training on Street Ge- 
stalt figures plus instructions to see only W’s 
on the Rorschach; Z training on the Street 
Gestalt test plus standard Rorschach instruc- 
tions; 3, no training but instructions to see 
W’s only; 4, no training but standard Ror- 
schach instructions, Group 7 produced sig- 
nificantly more W responses than any other 
group while neither training alone nor in- 
structions to give W only produced a signifi- 
cant increase in frequency of W’s. 


Nature of Rorschach Perceptual Processes 


Considering the Rorschach as a perceptual 
task, we might theorize about the nature of 
Perceptual processes involved in making W 
responses, and variables that influence these 
Processes. Perceiving a W response appears 
basically to be a problem of or 
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a 
to shake off one set in order to take a ney 
one . . . it implies flexibility in manipulating 
several more or less irrelevant or conic 
gestalts” (20, p. 111). In contrast, the sa 
Gestalt Test does not have a high loading 4 
the Z factor. 


Problem 


The purpose of this study is to eon i 
perimentally whether the Thurstone 4 an to 
factors are related to W and Z me 
the Rorschach. This relationship can be ses 
onstrated by contrasting Rorschach e 
of groups pretrained on Closure figures t fig 
tor 4) with those trained on Gottschald jne! 
ures (factor Æ). Responses of both m 
groups will be compared to responses ! ning: 
by a control group receiving no’ pretral 


Hypotheses 


ore 

1. Training on a perceptual task re 
taking the Rorschach test will alter t 
and Z responses of trained groups. Jete f8 

2. The group trained on the incomp ° aduc? 
ures test (Thurstone’s A factor) will eae 
more W responses and receive higher T did 
zation scores than a control group W i 
not receive perceptual training. ald 

3. The group trained on the Gotti 
test (Thurstone’s Æ factor) will give fe score 
responses and have a lower organization 
than the control group. 


Procedure 


ere 

Forty-nine volunteer college iale ur 
used as subjects. The seating plan us period’ 
Ing the Rorschach and the training P P 


was that of Harrower and Steiner (1% 


Table 1 
Experimental Design and Hypotheses 
Group N Training Rest Rorschach performance 
I i7 Closure practice using incom. 5 More W responses and higher 
plete figures Z scores than Groups II and mi 
II 13 Practice in breaking down Ge- 5 Fewer W responses and lower 
stalts and forming new units Z scores than Groups I and ut 
on Gottschaldt figures. A 
II 19 No perceptual training, verbal 5 W and Z scores intermediate to 
task 


` those of Groups I and II 
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| pee A 300 watt Viewlex projector placed 
N oe 21 feet from the screen gave a screen 
. p s by 40 inches for Card I. Subjects 
the old, previous to the experiment, that 
oy were volunteering for two experiments, 

ong conducted by a graduate student, and 
iin a: faculty member, and that a maxi- 
ache one and one-half hours would be 
ena to complete the work. They were as- 
When the one of three groups depending on 
ttainina ©, were free. After completion of the 
theca” period, subjects were reminded that 

i Roney also to participate in a second ex- 
might tp told that in the meantime they 
were t i e a 5-minute rest. These precautions 

that i en to prevent subjects from assuming 

riod w e instructions for the pretraining pê- 

od were supposed to hold for the Rorschach. 


iff , 
S erent experimenters conducted the two 
essions, 


Gror s 
before e I. Group I was trained on closure figures 
eing given the Rorschach. They were shown 


do s 
tom ele frame 35 mm, slides of closure figures 


taining = Mooney Closure Test (16). Figures con- 


Ose with irrelevant details were excluded, and for 
Otogra, Hi white figures on a black ground, the 
figures A ic negatives were used in the slide. The 
i jects To, Projected for 20 seconds each, and sub- 
bre orded their answers in a booklet. After the 
net mer the slides were again projected for 
ct a S each. This time the experimenter gave the 
em i, swers and helped subjects to see the figures. 
order io asized that all segments must be used in 
j roup my the figures, A 5-minute recess followed. 
| Ncealed I. Group II was trained on the Thurstone 
fication of Figures Test (21), a multiple-choice modi- 
lected wi the Gottschaldt figures. Figures were pro- 
lected with es opaque projector. A 
í it might be Higa other more complex 


3, Se 
Corre 


figures in which 
d to check 
hidden in. 


figure was Pro-* 


minutes. Subjects were given answer booklets and 
asked to write down what they saw or anything 
that the slides might represent to them. During the 
inquiry, the subjects were given sheets of achromatic 
reproductions of the blots on which to encircle their 
responses. Examples of whole and detail responses 
were given; the slides were projected again during 
the inquiry. 


Results 


The first response made to each card was 
scored for W and for Z, following Beck’s (2) 
procedure. As some subjects did not respond 
to all of the cards, separate analyses were also 
made of W and Z for the subjects who gave 
more than ten responses to the Rorschach. 

‘All analyses of variance for W and Z, ex- 
cept for number of rejections, were statisti- 
cally significant. Tests for homogeneity of 
variance showed nonsignificant differences 
(Table 2). As the direction of differences was 
predicted, one-tailed ż tests were used to com- 
pute the significance of differences between 
means. 

When compared with the Gottschaldt- 
trained group, the closure-trained group gave 
signicantly more W and Z responses. This 
was so when ¢ tests were computed using all 
subjects, OF when subjects were omitted who 
gave less than 10 responses. The Gottschaldt- 
trained group also produced signicantly fewer 
W and Z responses than did the control group. 
As predicted, the closure-trained group gave 
more W and Z responses than the control 


Table 2 


ee f 
j Sigmas, and Significance © 
Means, eatin (F) for W and Z 


Variance 


Group 
[ie E b 


o : 
sli «Practice slides and 21 test items were used. All z 
After po EDt the first, were seen for 30 secon Measure 
A e test. i i jected for 
See , the items again proje! A S 
‘conds each ‘and the correct answers pointed out. Al ae ga 431 565 345 05 
they oS Were told that to see the enclosed figures, Mean W 207 1.75 2.18 
and ṣo USt ignore the unity of the enclosing figure Sigma W 27.79 19.23 25.68 4.56 05 
G Ech out the smaller figure- z Mean Z g.00 7.11 8.66 
K vme III. The control group was given the Ship- Sigma Z w3 46 53 SED Se 
tial ote of Living Scale for Measuring Intel- M Rej. 
each wer Piirment (19). Time limits of 4 ae subjects giving more 
i © allowed lary and a 2 jonseS iga 
A Mons subtests. nn Me aac ne Bc “gh Toa 431 $62 385 05 
Rorschach administrati at! earch | 210 1.75 2.25 
mi administ VAP Bi eSt į 210 1. : 
fran ted inion, Tae RN DT fin! sez COL {ESE [29.70 19.23 25.84 6.15 01 
Kone Say slides of the blots pone Sita Z | 746 711 891 
aithful X i f } h eae pan ae SANS ss 
reproductions of | oP oF a-half — 
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Table 3 
Significance of Differences Between the Group Means for W and Z 


Groups compared Dif. W t p* Dif. Z 1 p* df 
All subjects m 
I-II 1.90 2.60 .01 8.56 2.96 005 34 
I-III -56 83 25 2.11 79 25 28 
II-III 1.34 1.79 05 6.44 2.18 025 
Subjects giving more 
than 10 responses 
HI 216 276 01 10.47 348 005 g 
I-III 84 1.14 AS 3.86 1.35 10 27 
I-II 1.32 1.71 05 6.61 2.23 025 


* p less than value indicated with one-tailed test. 


group, but the differences were insignificant 
(Table 3). 


Discussion 


The random design of this study has cer- 
tain definite advantages over a test-retest de- 
sign where groups are equated by means of 
their pretest performance. If subjects had had 
experience with the Rorschach, or with an 
other inkblot test, the response set established 
during this previous test might act to reduce 
or to eliminate the effectiveness of the set es- 
tablished in the training period. Since W and 


expected to be linear. Asking subjects for an 
arbitrary number of responses was decided 
against, and Cronbach’s (6, p. 426) sugges- 
tion of scoring a fixed number of responses 
was followed. If training results in changes in 
organization value and in number of W re. 
sponses given, then it is reasonable to expect 
that the effects of such training would be as 
apparent on the first response to a card as on 
later responses. If training effects did not ap- 
pear in first Tesponses, or if they were not 
demonstrable with the fairly small number of 
subjects used, then they would probably be 
of little practical importance. 


Exactly what was transferred fr On. ret 
to test period is unanswered in this oe 
Perhaps a way of responding had po- 
learned, or a transfer of a set which tem 
tarily influences the responses ane, to- 
might presume that some implicit atii he 
ward what the subject thought it was t How- 
was to do may have been transferred. that 
ever, we can conclude from the results u 
when homogeneous groups with no pren n 
experience with the Rorschach test (ane p a 
different types of perceptual training arate 
short period of time, in a situation SEP fet’ 
from the Rorschach itself, significant ce 
ences result in their tendency to produ i 
responses and to give organized resp t pic 
Thus, the groups present rather differen ott- 
tures in their Rorschach records. The parate 
schaldt group seems to possess & mM i sorts 
amount of intelligence of a practical ontro! 
while the Mooney group and the Er ab- 
group appear to possess a higher, ae a 
Stract type of intelligence. Apparently, A and 
easier to eliminate tendencies to organi? this 
to give W’s, than it was to increas? 
tendency. Perhaps training to increase © in. 
and Z scores must be accompanle reasi”Ë 
structions to see W’s, or by an re - 
Motivation of subjects to give W’s task: 
creasing their ego-involvement in me score 

The facility with which the W and jon 1? 
were altered indicates a need for cm < 
interpreting these scores in the light chac” 
Potheses advanced for them in Ros the 
theory. Perhaps greater structuring nce of 
test situation might lessen the influe 


Effects of Perceptual Training on the Rorschach 


eee factors on the protocol. However, 
mi Sioni enthusiasts may defend the test 
superficial that these changes in records are 
ting. The and occurred in an unusual set- 
interpreted might claim that when a record is 
an accurat as a whole, by a skilled clinician, 
emerge de € picture of the personality will 
cal ie changes in a few scores. Clini- 
the tie a of the protocols, as well as 
the differ ics of this study, impress one with 
Y the v. ences between the responses given 
f, various groups. 
iien very susceptible to situational 
© make ac en for a clinician to use it and 
subject ‘ail one predictions for a particular 
at are j require years of training at skills 
Municated mperfect and never readily com- 
Variables to others. Objective personality 
more need to be more precisely defined 
effort at ea alely measured, with increased 
Measurin educing the intuitive aspects of the 
Ment wit instruments. Only by this refine- 
ade avaj better predictions of behavior be 
ailable, 


Summary 


Th 

Bat ae of this study was to investi- 
ization variables which influence the ot 
Ponse to 2 Rorschach responses and re- 
eer colle Whole blot areas. Forty-nine volun- 
one of ik males were randomly assigned into 
training ree groups. Two groups received 
Coney Ce perceptual tasks, either the 
figures b osure Figures, or the Gottschaldt 
Contro] efore taking the Rorschach. The 
stitute FOup was administered the Shipley- 
lectual “a Living Scale for Measuring Intel- 
tual test. Petment, a verbal and nonperceP- 
the raging its training period. Following 
Petimenter® and a short recess, another ex- 
Whic nter administered the Rorschach test, 
Since vw. introduced as a second experiment. 
of resp and Z scores depend on the number 
trolle, onses given, length of record was COn- 
e Ea analyzing only the frst response 
Variance each card. Four simple analyses ° 
of Fwy, Were made of W and Z scores. Values 
the free Statistically significant and tests for 
Se te of the differences between 

iL Were made. 
© group trained on the Gottschaldt 
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figures had significantly lower W and Z scores 
than the other two groups. ` 

2. While the Mooney-trained group’s W 
and Z scores were higher than the control 
groups, as predicted, these differences were 
statistically insignificant. 

So long as situational variables incidental 
to the testing situation can be suspected of 
creating a significant alteration in the W and 
Z scores, then the variance of these scores, 
that is attributable to pervasive personality 
dimensions is in serious question. Thus, fur- 
ther caution must be exercised in the inter- 
pretation of Rorschach W and Z scores in 
light of the Rorschach hypotheses given for 
them. It is suggested that greater structuring 
of the test situation might decrease the tend- 
ency of W and Z scores to reflect transient 


sets. 
Received July 7, 1955. 
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The di 
Wiese ana between reports of clinical 
ous dilemma i research data has been a seri- 
er of years On Rorschach circles for a num- 
ave been it n the one hand, many clinicians 
the validit mpressed with the usefulness and 
Tange of = the Rorschach method in a 
Search find ications, while, on the other, re- 
Ported this ce have not in the main sup- 
as been aap One such application 
Schach as a e considerable use of the Ror- 
disorders, n aid in differentiating psychiatric 

ormu 
Sies in pae on the assumption that differ- 
ected in cntie conditions would be re- 
Were e a data, early investigations 
Ports of ie 7 concerned with descriptive re- 
a One or m ypical Rorschach performance 
result, IRE psychiatric populations. As 
: ols were istical and/or experimental con- 
tead, clinical d generally employed, but in- 
wore ti escription was accepted with- 
'Orkers eT verification. Later, some 
ilferences cee to isolate the qualitative 
tes, yet SLE oy between patient groups 
whi ndings ‘se the . holistic” nature of the 
— collects y deriving patterns OF signs 
si ong nosolo vely seemed to discriminate 
Ets were re gical groups. Thus, a variety of 
ere found ported, for example, signs which 
Psychoneurotic brain-damaged individuals, in 
tay useful 1633, 10 schizophrenics, and which 
Valuation e s indices of adjustment in the 
A y ta quae (17, 18, 14, 8, 
re employed in when many of these signs 
cats in subsequent investigations, 
Yongan oe Bae paper was presented at the 
k oF as gical Association meetings in New 
Payad the ne of Psychiatry, College of Medi- 
Opathic Hospital of Clinical Psychology: Iowa 


the significant discriminati i 
were not corroborated ee Sap eer 
fact that signs derived in the original in À 
gations provided better Nahe or ma 8 
the initial sample than within subse a iz 
populations is not too surprising. In one 
these studies, signs were obtained by eek 
ing for prediction those few aspects of Ror. 
schach performance which showed the hi h- 
est relationships from among the valable 
predictors which had a low correlation with 
the criterion. Such a procedure tends to capi- 
talize on chance fluctuations within the sam- 
ple, and consequently may result in a spu- 
riously high multiple-correlation coefficient 
When signs which were derived in this mae 
ner are applied to subsequent populations, it 
d that the coefficient will be of 


can be expecte' 
lower magnitude and of less predictive value 


than that obtained in the parent population. 
Other investigators have studied the extent 
to which Rorschach single summary scores 
can discriminate among psychiatric groups. 
(23) studied 39 


Wittenborn and Holzberg 

summary scores with five patient groups and 
found that one score (CF) significantly dis- 
criminated the manic from the depressed pa- 
tients. Friedman (6) evaluated the discrimi- 
native effectiveness of Rorschach scores wil 
al adults and 30 schizo- 
hrenics. He rschach variables 
which significantly i schizo- 


cated samples of 
and neurotics. The results indicate that six 


scores were significant at the .10 level of con- 
fidence OF better between the clinical groups 
for both samples. Kobler and Steil (12) re- 


ported no statistical differences of any con- 
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sequence between the Rorschach scores of the 
paranoid and depressive subgroups of involu- 
tional melancholic patients. 

While the findings with Tespect to single 
summary scores are predominantly negative, 
unequivocal evaluation of these data is diffi- 
cult. Most studies were able to obtain a few 
scores which discriminated among psychiatric 
groups. However, in some instances, the posi- 
tive findings could be expected by chance be- 
cause of the large number of tests of signifi- 
cance computed. It should also be noted that 
although a variety of Rorschach scores have 
been reported as differentiating diagnostic 
groups, there has not been a great deal of 
consistency for these scores to appear re- 
peatedly as diagnostic from study to study. 
In addition, certain methodological limita- 
tions such as small samples, incomplete sta- 
tistical or experimental controls, and vaguely 
defined diagnostic criteria have complicated 
the interpretation of the results. 

In the light of the ambiguous nature of the 
research findings, 
tion of the instrument, the need for a sys- 


Procedure 


Our subjects were selected on the basis of 
the following criteria: (a) chronological age 
of 15 years or older; (b) unanimous agree- 
ment among psychiatrists as to diagnosis both 
on admission to and discharge from the hos- 
pital; (c) diagnosis was restricted to psycho- 
neurosis (Pn), psychopathy (Pp), or schizo- 
phrenia (Sc); (d) diagnosis was independent 
of the Rorschach data,? and (e) the number 
of Rorschach responses (R) would not con- 
tribute to a Significant difference in the mean 


It was not Possible to obtain complete independ- 
ence of diagnosis and Rorschach data. However, this 
criterion was met to the extent that the initial im- 
pression and the admission staff diagnosis were made 
rior to the Rorschach administration, 
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number or the variance of responses for the 
three groups. ° va HEMT 

Initially, over 800 case records of pal 
who were 15 years or older, and who a 
given the Rorschach test during the sky 
period from 1948 to 1953, were examined t- 
order to check on the agreement and con 
ency of the psychiatric diagnosis. Each E 
folder contained an initial diagnostic me 
sion usually made by a psychiatric res! i 
or a staff psychiatrist, an admission and aA 
diagnosis, and a final discharge staff aa 
nosis, both of which were made by ee 
residents and one or more staff payon y- 
In this way 339 Rorschach records were rece 
tained, and the number of responses per we 
ord was determined. Statistical tests er 
no significant difference between the mee 
number of responses for the three em vere 
While the variances between the groups ata 
significantly different. Inspection of the 
indicated that two cases in the Pn group AY 
with 153 responses, were contributing E ently 
to the heterogeneity of variance. ConseqU and 
they were withdrawn from the sample re 


eat 


Ea ° wel 
Statistical tests of means and variances rer: 
recomputed. The groups showed no nses 


ences in either the total number of TR 
or variances, so that the effects of R on 
Rorschach scores for the three groups 
considered approximately equal. ceting 

A total of 337 Rorschach protocols H pn'ss 
all the criteria and obtained from 13 pasic 
106 Pp’s, and 100 Sc’s comprised the eq 
data for this study. In order to assure eac 
treatment of the data for all subject ind 
Protocol was rescored according to yoo jnci 
system described by Hertz (9).* T cluded 
dence of clinical types which were aoit 
within each of the three major saaition” 
groups is presented in Table 1. A s are 
subject characteristics of the three grour™ ted 
given in Table 2. From this it will ae 
that there was an unequal number “iis was 
and females in each group, and that e dif- 
most discrepant in the Pp’s. The en not 
ferences in age between the groups ireren 
statistically reliable, although the o jzatio® 
in education and length of hospita ciati 

*The author wishes to express his 2PP scha” 
to Donald Spangler for rescoring each 2 
protocol. 
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Table 1 
Frequencies of Subclinical Types Within Each Major Diagnostic Group 


P P 
m Sychoneurotics Psychopaths ae 
ixe 

Anxiety 31 Psychopathic pers. 38 Paranoid 46 
Psychasthenia 30 Path. sexuality 18 Simple R 
Ysteria 28 Path. emotionality 14 Hebephrenic 8 
Curasthenia 22 Psychotic episodes 12 Mixed 7 
Mpulse neurosis A Neurotic traits 8 Catatonic 4 
ypochondriasis 3 Inadequate type 7 Acute 3 
sychosomatic 4 Asocial trends 3 Defect state 1 
active depress 2 Alcoholism ? 2 Unclassified 18 

Nelassified 2 Paranoid tendencies 2 

2 Exhibitionism 1 

T Malingering 1 
‘ota == — pus 
: 131 106 100 


Were sign: 

aes i E at the .01 level of confidence. 
igher th ional level of the Sc’s was slightly 
the Jen a that of the Pn’s and Pp’s, while 
er os of hospitalization was slightly 
Stoups, D the Pp’s than for the other two 
to the ot@ Were also available with regard 
ness, subject’s previous admission and ill- 
haq Tees fh -seven per cent of the Pn group 
Per ce ill prior to this admission, whereas 
So's T of the Pp’s and 23 per cent of the 
Bures in TER ill previously. Generally these 
cent of th icate that approximately 72 per 
e tima total sample were first admissions 
nd that th condition was administration, 
> Cons} eir condition was not, for the most 

Me Satins chronic. 
Yere un Means, and standard deviations 
followin puted for each clinical group On the 


Short 


ture, Blood, Sex, Anatomy, Object, Fire, Po- 
sition, Contamination, P, 0%, and Rejection. 
Inspection of these figures indicated marked 
differences in the medians and the means for 
many of the scores, supporting previous ob- 
servations that most Rorschach scores are not 
distributed normally (4, 5). In addition al- 
most half of the scoring categories had me- 
dians of zero and means of less than 1.0, 
which not only suggests that these scores oc- 
curred very rarely, but also that they have 
very limited utility in individual differential 
diagnosis. With the exception of the c, ch', 
Position, and Contamination scores which oc- 
curred very infrequently, chi-square tests of 
independence were employed to evaluate the 
significance of differences between the groups 
for the remaining 34 summary scores. The 
dian derived from the total sam- 


o 
Dro Mg summar P -all me 
y scores: R, W% D%, over-a $ 7 
Ye 5, P%, F+ % of 80 F+ ve 60, ple (337) for each score was va s yes 
has a FC, CF, C Fch, chF, ch, Fch', pirical cutoff point. Yates ia per ete 
SSMS Res OF «gi A%, Ad, H%, Hd, Na- continuity was applied to the 
Table 2 
Subject Characteristics for the Three Groups (v=337) 
-chopaths Schizophrenics 
Pa SE) GM2 P) G78 
Sex Mean SD Mean SD Mean SD 
ne 27.7 9.6 
6.9 9.8 
as 273 $ Ll 25 4 3.2 
11.7 A ws IS 558 45.3 


102 Irwin J. Knopf 
Table 3 
Medians, Means, and Sigmas for the Larger Clinical Groups on the Significant Scores and the 
i Probability Values Obtained from Intergroup Comparisons 
Intergroup aie 
Pn (N=131) Pp (N=106) Sc (N = 100) value probabi . 
8 P „Sc PuSé 
Score Mdn Mean SD Mdn Mean SD Mdn Mean SD Pn-Pp Pp 
01 
z z zg 28 i 
11.0 144 13.8 65 10.0 11.4 15.0 15.8 12. ‘O1 
ris 50.0 48.0 17.4 51.0 50.2 18.0 4.0 434 17.0 02 
FM 20 27 24 2.0 2.6 25 2.0 2.0 2.0 01 02 
P S0 51 2.2 5.0 5.2 2.5 40 41 2.0 i ‘OL 
Sex 0.0 0.5 1.2 0.0 0.2 1.0 0.0 0.9 28 a ‘01 
Anatomy 10 Z5 33 1.0 1.7 2.4 1.0 2.6 4.3 : 


* Only probability values at or beyond the .05 levels are reported, 


cell frequencies were lower than ten (13). 
The null hypothesis was retained with those 
chi-square values which did not meet the 
minimum requirement of the .05 level of 
confidence. 


Results 


Although tests of significance were not 
computed, the incidence of occurrence of 
contaminated and position responses will be 
presented because some Rorschach workers 
have regarded these responses as diagnosti- 
cally important in that they are almost al- 
ways associated with schizophrenia or psy- 
chosis (1, 2, 10, 20). Our data, however, 
indicate that these responses can and do 
occur in other psychiatric conditions. For 
example, we found contaminated responses in 
9 Ses, 2 Pn’s, and 1 Pp, and Position re- 
sponses in 2 Sc’s, 5 Pn’s, and 1 Pp. Moreover, 
when we consider that only 12 patients out 
of the total sample of 337 produced con- 
taminated responses and only 8 patients pro- 
duced position Tesponses, it is apparent that 
diagnostic classification cannot be effectively 
made solely on the basis of the presence or 
absence of these responses. 

The over-all chi-square tests applied to 
each Rorschach score for the three clinical 
groups resulted in significant values for the 
following six scores: Dr%, A%, FM, P, Sex, 
and Anatomy. Three additional chi-square 
values were computed for each of these sig- 
nificant scores to determine more specifically 
which group or groups the scores discrimi- 
nated among. Table 3 lists the medians, 


ee these 
means, and standard deviations for 


ob- 

Scores, as well as the probability ie e 
tained from the separate comparso i a 
clinical groups. Most apparent from t jmina 
is the failure of any one score to a gcore 
among all three groups, although thre ons: 
were discriminative in two comparis cantly 
will also be noted that five scores Sien pereas 
differentiated the Pp’s from the Sc’s; 1, from 
only two scores differentiated the Pe spe 
the Pp’s, and the Pn’s from the Sc’s- redian® 
tion of the data and reference to the e i 
and means listed in Table 3 idioat pp’s 
rection of significance. There were mM on FM 
who were lower on Dr%, and higher 1 
than Sc’s; more Pn’s who were lower pn's W» 
and higher on A% than Sc’s; more pps 4 
were higher on FM than Sc’s; Loe and 
Pws who were higher on P than on S% 
more Pn’s and Sc’s who were higher 
and Anatomy responses than Pp ais as 

The F + % score is often regar from 
portant in differentiating psychotic a f 
psychotic subjects. However, the aoe int 
dian value of 80 per cent which was rimin? 
from the total sample did not diera sub 
among the clinical groups. Beck Oty uset 
gested 60 per cent as a diagnostica core WE 
cutoff point, and consequently this SC? chi 


iw 


employed with the present data. / erence? 
Se values indicated significant Ee PP $ 
between the Sc’s and the Pn’s, a of Oe 
and Pn’s at the .001 and .05 pene tË f 
fidence respectively, while no signilc?, ay 
ference was obtained between the ef 


P re 
the Sc’s. Recognizing that there 4 


=—. > 


zo 
—_— 
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Table 4 


Medi 
edians, Means, and Sigmas for the Clini 
Probability Values Obtained 


cal Groups of 50 Cases on the Significant Scores and the 


from Intergroup Comparisons 


Intergroup chi-square 


Pn (N=5 g 
—_ = (V=50) Pp (N=50) Sc (N=50) value probabilities* 
Dr% Mdn Mean SD Mdn Mean SD Mdn Mean SD Pn-Pp Pp-Sc Pn-Se 
8.0 - - 
y 10 13.0 70 99 14 14.0 16.5 13.2 o 05 
Eer i h 2.2 10 18 15 10 16 28 ooo 
a 0 n 1.5 o0 05 18 o0 05 10 ao 05 
= AN S 22. 50 52 24 40 40 20 oO 
natomy 10 0.6 16 o0 01 04 00 10 25 ‘02 
s 2.6 3.2 10 15 19 20 28 29 o5 01 


* 
Only 
prebe a 
ability values at or beyond the .05 levels are re 


ences į 
which inches Hertz and Beck scoring systems 
Computing T. F + tables and procedures for 
Suggest that T Jo, these findings nevertheless 
Per cent eck’s empirical cutoff point of 
Biles conan, also be discriminative with 
n Se method. 
to ee the results, it seemed impor- 
actors could ac the extent to which chance 
ferences p account for the significance of 
Orschach etween the groups for the seven 
all ¢ i-squ scores. Having computed 34 ovet- 
mately ty are values, we can expect approxi- 
at the Os be significant merely by chance 
as P Rai of confidence. In the light of 
of the SaM a more rigorous examination 
essentia] mo of the present findings seeme 
clinical gr erefore, 150 cases, 50 from eac 
he total oup, were randomly selected from 
Ment i sample of 337. Statistical 
Te the analysis of the data for 
Shy: the same as that previously 
th e Villines the parent population. hi- 
š Š Ro s were obtained separately for 
Cores whi rschach scores, and only those 
Ples were ich were significant On both sam- 
tiene ce stable: 
Tete age for the new sample 
Bri tomy aa the Dr%, M, Fch', P, Sex, an 
ThePs at a res significantly differentiated the 
fox media e .05 level of confidence OF better. 
or each ns, means, and standard deviations 
ae obtains together with the probabiilty 
the gro ined from the separate comparisons 
Sults iggy PS are shown in Table 4. These re- 
“icant, cate the Pp’s and the Sc’s i 
Y differentiated by five scores, 


this 


descri 
ib 
Squar ed 


ported. 


only two scores differentiated the Pn’s from 
the Pp’s, and the Pn’s from the Sc’s. In com- 
paring these findings with those obtained from 
the parent sample, we find, that only the 
Dr%, P, Sex; and Anatomy scores signifi- 
cantly discriminated the clinical groups on 
both samples, and thus met the criterion of 
stability. While all four stable scores discrimi- 
nated the P's from the Sc’s, these scores 
were less sensitive in differentiating the Pws 
from the So's, and the Pn’s from the Pp’s in 
that only one score for each comparison was 
found to þe significant with both samples 


(Dro and Sex, respectively). 


Summary and Conclusions 

the extent to which Ror- 
scores could discriminate 
populations, & total of 337 
h records obtained 
d 100 Sc’s were 
f independence 


To determine 
schach summary 


among psychiatric 
carefully selected Rorschac 
from 131 Pns, 106 Pp’s, an 
analyzed. Chi-square tests 0 
ted on 34 Rorsc 


the total sample, 


jminative 0D 
The results show! 


ach summary scores 


ed that: 
are not 


2. Almost half of the scoring categories had 
medians of zero and means of less than 1.0, 
not only indicating the rareness of these re- 
sponses ing the limited 


put also underscor! 
utility of these scores for differential diag- 
nosis. 
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3. Contaminated and position responses can 
and do occur, albeit infrequently, in all three 
groups and cannot be regarded as pathogno- 
monic of psychosis or schizophrenia. 

4. On an over-all basis, four scores: Dr%, 
P, Sex, and Anatomy significantly discrimi- 
nated among the groups on both samples at 
or beyond the .05 level of confidence. 

5. When specific tests of significance were 
made, no single summary score significantly 
differentiated all three clinical groups. 


6. For practical Purposes, Rorschach sum- 
mary scores cannot be regarded as effective 
in differentiating psychiatric groups. 


Received July 19, 1955. 
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Analys; 
e re a the Rorschach test by either 
a compariso or Beck scoring systems includes 
Ose card n of the response productivity for 
10) with which are entirely chromatic (8- 
maining ca a number of responses for the re- 
em, the ug s. This factor in the Klopfer sys- 
Percentage -9-10 per cent” (8-10%), is the 
© the tot Aone outed by Cards 8, 9, and 10 
ard for a number of responses. The stand- 
mations a> factor is based on statistical esti- 
Ponsen a ding to the assumption of D re- 
in the fi os and the distribution of D areas 
per ee which gives an expectancy of 
cards. In ah Of responses in the last three 
affective io system the comparison is an 
respons e (AR), obtained as a quotient 
Onse total in Cards 8-10 divided by the re- 
0.60 in Cards 1-7. He reports a mean 
adults D 0.19) for a group of normal 
al ran nd considers 0.40 to 0.80 as the nor- 
measure Beck looks on this factor aS “a 
> leasurable the readiness to quicken to life’s 
Teats it e experiences” (3), and Klopfer 
Stimuli f as indicating “a responsiveness to 
e Fa without which is even less under 
Se of seine control of the subject than the 
ar signifi ion and color elements” (7): Simi- 
this fact cances are assigned to deviations of 
is or—when the ratio is high, the sub- 
volatile, liable to excitement, an 
when 


stimul. 
ated ; 
‘ by environmental impact; 


Sp 


4 From 
Omah the Veterans Administration Hospital, 


a, Nebraska. 


low, he is under-responsive to emotion-toned 
stimuli and inhibited or lacking in respon- 

siveness to strong environmental impact. 
The literature discloses several studies deal- 
ing with the validity of color as the deter- 
minant of responsiveness in the 8-10% hy- 
pothesis. Sappenfield and Buker (9), Dub- 
rovner, Von Lackem, and Jost (5), Perlman 
(8), Buker and Williams (4), Allen, Stiff, 
and Rosenzweig (1), using various patient 
and normal groups; and all employing the 
technique of achromatic presentations, agreed 
in finding that the number of responses on 
function of color. It was 


g—9-10 is not a 
pointed out (8); however, that while the ex- 
perimental evidence indicates that color is not 


an active factor in the g-10%, the possibility 
remains that there is validity in this factor as 
a personality variable. 

The purposes of the present study are, first, 
to explore the validity of the 8-10% and the 
AR as a gross personality variable insofar as 
personality is implied in normal and psycho- 
diagnostic groups, an second, to supply some 
normative data for the 8-10% hypothesis, 

ement the norms for the affec- 


and to suppl 
tive ratio. 
Study 
The subject groups consisted of normal, 


and schizophrenic adults, and nor- 
problem, and mentally- defec- 
The neurotics and schizophren- 


neurotic, 
mal, behavior 
tive children. 
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Table 1 
Subject Groups, Age, Response Total, AR, and 8-10% 
-10 
Age R AR 8-10% 
- SD + 
Mean 
G N Mean SD Mean SD Mean SD 
Troup ri N 
8.1 
5 38.2 
E 36 16.24 650  .238 105 
v 39.31 10.89 28. 6 35.4 
Normal 7 bn 635 mar 10% ‘504.202 34 ios 
Poe ite 119 29.81 6.21 27.24 18.75 523.245 af 
chizop! 
37.8 
cian 196 12.97 3.14 27.20 12.29 643 pen 38.4 93 
pone inded 39 12.95 2.09 14.77 3.34 -666 2 354 vi 
aren problem 49 12.37 3.02 20.67 10.14 -567 77 
first 
ta were Fi 
ics were VA hospital inpatients diagnosed by males and females, and the da ithin 
the psychiatric staff independent of considera- 


tion of the Rorschach test 8-10% or AR; 
the behavior problem group was composed of 
children referred to a psychological service by 
schools and courts for behavior disturbances; 
the mental defectives were institutionalized; 
the normal subjects were residents of a small 
midwestern community ? located in the same 
geographical locale from which the diagnostic 
groups came. 

The Rorschach tests were individually ad- 
ministered and the protocols analyzed for 
computation of the 8-10% and affective 


ratio. No record with fewer than 10 responses 
was included. 


Results 


The subject groups, identifying information, 
and findings for the 8-10% and AR are pre- 
sented in Table 1. All groups, excepting the 
neurotic and schizophrenic, consisted of both 


2 The records were taken 


from a larger study done 
under the supervision of D 


r. Marshall R. Jones and 


. v 
analyzed to determine sex ginaren e 
each group. Since statistical analysi t differ 
no conventionally-accepted siguien for the 
ence in the 8-10% or AR, the da 
males and females were combined. . ¢nificane 
The differences were treated for “ie adult 
by means of the ¢ test and, ae 
groups, the normals and earl the 4% 
differentiated significantly by eee respet” 
and the 8-10% (t= 4.44 and 4. n the nor 
tively, both p < .001), and a e & 
mals and neurotics the difference : signif” 
10% achieves a level of convention £00 


unt, 
cance (¢ = 2.00, p < .05). It was fo at Jess 


. s n 
that the age differences are signiñch aii H 
than .01 between all three pied e signi 
differences in response total (R) 


ics 
1rotle? g, 
cant between the normals and neu ic 


A re 
between the neurotics and ae i 
Thus, further refinement of the S each °, 
tempted by selecting 45 subjects “arposè s 
the three classifications for the A respon 
Matching them on mean age an a 


5 
roup 
supported by the University of Nebraska Research total. Results for these matched & 
Council. Presented in Table 2. 
Table 2 
Matched Adult Groups, Age, Response Total, AR, and 8-10% 
7 g-10% 
Age R AR me 
Group i 
(N= 5) Mean SD Mean sp Mean SD = M 
8. 1 
Normal 35.29 6.86 24.09 11.10 649 212 S8 12 
Neurotic 34.53 5.76 24.07 11.62 .604 320 29.9 
Schizophrenic 34.02 4.95 24.16 13.72 455 223 
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Table 3 
Differences on AR and 8-10% for the Matched Groups 
AR 
8-10% 
Groups t p = 
Normal vs i 
. Schizophreni i 
N i chizophrenic 4.22 
eurotic vs. Schizophrenic 2.53 Eo 517 Zor 
K .02 317 <.01 
San Table 4 
Subject J 
jects, Cutoff Scores, Number, and Percentage of Cases for Both the AR and 8-10% 
40 
Unmatched groups Matched group: 
Ma S 
No.cases 
ca No. 
E N 8-10% 225. d N 810% 228. % 
Curotic ie! i ne 43 
i j 1 
Chizophreni 70 10 14.29 = 5 55 
" 14.29 5 13.33 
119 33 27.73 45 16 35.55 


Analysi 

ne prs these findings reveals that none 
CUrotics į ences between the normals and 
“€Ptable = statistically significant at the ac- 
uaa, confidence. Significant dif- 
€ normals can be made, however, between 
a Le schizophrenics and between 
‘and 8-16 ee schizophrenics on both the 
Ban the aye ee as listed in Table 3. 
“able 1 reveal ildren groups, inspection of 
IRAIA, s that both the AR and 8-10% 
Toblem gro cantly differentiate the Behavior 
as Deo stom both the Normals and 
cae the Seco but the differences be- 
sima significant. two groups are not statisti- 
ie larity of the It is interesting to note the 
€viation ¢ mean ratios and their stand- 

al adile, for the normal children an 
the chil s. Further analysis of the data 
& ee population has not been made. 

e — of the practical significance 
atin would = a cutoff point was sought 
pre’ effective ord the maximum differenti 
in wuts the ness of the measures. Table 4 
each of the umber and percentages of cases 
Of 334 e groups falling at or below an 
a All of oe the equivalent g—10%)- 
ii S felt i differences are significant, 
Station of at these findings support i 
the occurrence of a very 10W A 


Indj 
Proves § 


for 


. Jes 
Which 


and 
nter- 


or 8-10% as contributing evidence of pa- 
thology of a schizophrenic or neurotic nature. 
No effective cutoff point could be made at the 
upper end of the ratio distribution since all 
three groups showed a similar scatter of a 
few cases within the upper range. This, it is 
felt, suggests that a high AR or 8-10% is 


not differentially useful. 


Discussion 

ained show that the AR and 
e discriminating value for 
t at the Jevel of broad 
Confining at- 


The results obt: 
8-10% do have som 
personality assessmen 
psychodiagnostic classification. 


tention to 


that the normals an 
significantly with respect to mean , and 
i ike normals than 


are consistent in the direction 
of deviation from the other two groups. Tt 
would probably be agreed that there are per- 
sonality variables related to normality, neu- 
roticism, and schizophrenia which seem to 
vary on a continuum of intensity in this or- 
der. In terms of personality disturbance, the 
neurotics as à group, while heterogeneous, are 
characterized in comparison with normal in- 
dividuals by the presence of dysfunction, and 
schizophrenics as even more disordered. Simi- 
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larly, this view may be applied to the results 
obtained from the child populations in the 
sense that a group of behavior problem chil- 
dren differs from their normal peers by dis- 
turbances of personality, whereas perhaps the 
greatest difference between normal and men- 
tally defective children is more exclusively 
one of intellect than grosser personality func- 
tioning, so that these two groups tend to 
stand together in contrast with behavior 
problem disorders. 

It is felt that the studies which conclude 
that productivity on Cards 8-10 is not sig- 
nificantly influenced by the presence of color 
prevent interpretation of these ratios in terms 
of emotional characteristics of the psycho- 
diagnostic groups or of the traditionally-held 
relationship of emotional reactivity to color 
stimuli on the Rorschach test. Findings of this 
study, however, support Perlman’s suggestion 
that perhaps this factor is related to a per- 
sonality variable, and supplies the basis for 
further investigation along such lines. The 
data reported herein may be of use norma- 
tively for both the 8-10% and affective ratio. 


Summary 


The AR and 8-10% ratios were computed 
from the Rorschach protocols of 654 subjects, 
representing groups of normal, neurotic, and 
schizophrenic adults and normal, behavior 
problem, and mentally defective children. 
Significant mean differences between some of 
the groups are obtained which suggest a re- 
lationship between the ratios and gross per- 
sonality differences such as are implied in 
normal and psychodiagnostic groups. A cut- 
off point is suggested in the interest of the 
practical significance of a low ratio in dis- 
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criminating normal individuals from A 
with neurotic or schizophrenic pathol 
Findings from earlier studies are cited as a 
basis for caution in interpreting these a | 
in terms of emotional reactivity to © | 
stimuli on the Rorschach test. i 

The present findings are offered a i 
normative data for the 8-10% and as § | 


s some 


plemental norms for the affective ratio. 
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R 
orschach Approach Type and the Organization 
of Cognitive Material’? 


E. Robert Sinnett and Ruth Roberts 


Student Counseling Bureau, 


The 

Potheses aly ose of this study was to test hy- 
an individual t relationships between the way 
and the tows organizes the Rorschach stimuli 

„The Aed thinks in cognitive tasks. 
his percept er in which a subject organizes 
interprete Oke the Rorschach is commonly 
1, 8, 9) a y authorities on the test (e-8- 
Cognitive hl yielding information about his 
N E A preponderance of whole 
s ft pi De that the individual 
op ter, Em a ize or think in an abstract 
t the Hon. asis on the usual details (D) 
"Ntive to Mofo that the subject is at- 
ic environmer obvious, practical aspects of 
an of rare eae and seeing a large propo- 
a may b etails (Dd) means that the per- 
beng trivial e pedantic and overly concerne 
€ percent, aspects of his environment. T. hus, 
0 make ce of W, D, and Dd are used 
erences about thought processes- 


hek 
e pro i 
th portions are referred to collectively 


P 


tend. $ 


i 


> 


e 
approach type (Ap). 


t 
T 
as 
ay *biects Method 
Minnesota stude subjects were University of 
dea Tena who were attending classes 
a t Gethin Skills Clinic at the Stu- 
ee n: the E Bureau. Two samples were 
l èi dents, and itial group was composed of 43 
ted of 69 the cross-validation group Con” 
subjects. Both samples were ex- 


k hausti 
ses dur- 


| 


F ver 
In oa 
8 the fay) 1l students attending clas 
tt This quarter and the winter quarter © 
tom ve St 
nesot 
ta, 
W 
Dora Ni 
ri ish 
early CY 3 a raga our appreciation to Mrs. 
Phase: olas for suggestions and help in the 
S of this study p 


d by a research grant 


u 
dy was supporte 
University of Min- 


eG 
taduate School of the 


University of Minnesota 


A her" oo year participated in 

Rorschach. A group Rorschach was ad 
ministered to groups averaging about ten in 
size. The instructions for the free association 
were paraphrased from Beck (1) and the in- 
quiry for the location of the responses is de- 
scribed by Harrower and Steiner (5). No in- 
quiry was performed in order to establish the 
determinants of the responses. 

Reading comprehension. After surveying 
the reading instruments available at the col- 
lege level, the paragraph reading comprehen- 
sion section (items 81-100) of the Diagnostic 
Reading Tests, Survey, Form B, was chosen 
mainly because the multiple choice answers 
could be reliably coded in terms of generali- 
zations and details for the purpose of this 


study. 


Jn addition, the items have alternatives 


which are “true” in the sense that they are 
factually presented in the stories, but incor- 
rect in answer to the question. Thus answer- 
ing a question confronts the subject not only 
with the problem of selecting an alternative 


which appears in put he must 


discriminate the 


vant to the ques 
zations and details. Unfortunately there were 


no alternatives which were “true” but ir- 
relevant generalizations and also there were 
few incorrect generalizations alternatives. The 

d into two groups: (a) 


items can be classifie 
re the subject must select the rele- 


those whe. 
tions from among alternatives 


vant generaliza 
» put irrelevant details, incor- 


including “true 
rect details, and possibly an incorrect gen- 


eralization, and (b) those where the subject 
must choose the appropriate detail from 
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“true” but irrelevant details and incorrect 
details. Ten items involved selecting the ap- 
propriate generalization and seven involved 
selecting the appropriate detail. Three items 
were unclassifiable using the criterion of 
agreement by three of four judges. 

Since most of the item alternatives which 
were generalizations were right answers, a 
preference for generalizations in answering 
items would lead to more correct answers to 
questions directed toward a main idea. Con- 
sequently it was predicted that an emphasis 
on W (as indicated by number and percent- 
age of W) would be Positively related to at- 
taining the correct generalizations on the read- 
ing test, but an emphasis on details (D+ 
Dd) would be negatively related to attaining 
correct generalizations on the criterion. 

Another index of intellectual organizing ac- 
tivity is Beck’s Z. This takes into account 
not only the subject’s attempt to organize 
the stimuli into wholes, but also includes the 
integration of details commonly perceived as 
Separate. Beck interprets Z as “. . . the ca- 
pacity to grasp relations not perceived by 
others” (1, Vol. 2, p. 12). Since it has been 
found that scoring Z in unit weights bears 
such a high relationship to Beck’s weighted 
Scores (10), unit scores were used in this 
study. It was predicted that Z would be posi- 
tively related to attaining correct generaliza- 
tions and correct details on the reading test. 

An overemphasis on W in the Rorschach 
protocol is interpreted as a lack of attention 
to the practical, obvious aspects of problems. 
Hence, it was predicted that W and W% 
would be inversely related to attaining cor- 
rect answers to the detail items on the read- 
ing test, but an emphasis on details (D+ 
Dd) on the Rorschach would. be positively 
attaining correct answers to 
detail items.? 

In order to test these hypotheses independ- 
ent of the effects of reading speed, each of 
the Rorschach variables used above was re- 
lated to the percentage of correct generaliza- 


3 Originally, we had planned to use number and 
percentage of D and Dd, but the number of Dd re- 
sponses was too few to warrant a separate analysis 
(M = 1.25). This finding is comparable to that of 
Harrower-Erickson and Steiner (5) who obtained a 
mean of 1.3 Dd responses, 


E. Robert Sinnett and Ruth Roberts 


tions of the generalization items attempts ‘ 
by the subject, and the percentage har 
rect details of the detail items attempted. 


., he ‘ 
Thus, sixteen tests were made relating t 


Rorschach variables (W%, number of ie | 
sponses, number of [D + Dd] responses, bles 
Z) and the reading comprehension = id 
(number and percentage of correct ae ae 
zations, and number and percentage 0 
rect details). t 
To test ~ above hypotheses independen 
of the effects of intelligence, the Vestn 
section included in the reading comprehen 
test was used for statistical control. Alt to 
ACE scores were available on 84 per one 
the sample and it has been more thoro su 
studied and used as an intellectual ee 
we felt it would have been uneconom Sag 
discard 16 per cent of the sample in oF sam- 
have complete data for each case. ee o- 
ple of 36 cases in the first group t with 
cabulary test correlated .59 (p < a of 
the ACE. This lends support to the = 
this measure as an index of inte ee the 
Story recall. One might argue the be- 
above predictions would not be congri 
cause the Rorschach gives a measure tim Jus 
the individual organizes ambiguous $ situ 
material, whereas in more structure¢ n tests 
tions such as the reading compr "en jn ae 
the subject may be able to shift his oe ques" 
cord with the structure provided by t a hig” 
tions. For example, if a subject wi a dis 
W% were asked a question involving nt de 
crimination of relevant from irreleve set 
tails, he might shift in accord vit ame” 
Provided by the question. W% itself "iven by 
able to shift as a function of the set 8 
the experimenter (3). sk was 
For this reason another criterion tā viable? 
selected to see if the Rorschach S strut 
would predict performance in a E o 
tured task. For this purpose free ee an 
stories containing both generalizatio in this 
details was chosen. The stories use perso”? 
study may be found in Center nae He | t 
(2, pp. 28-30). Each story contained C° ions 
which could be coded into two genera 


3 tor, 

and two details. After reading each $ EE 
pard 7, 

5 


re; 


Ber! 
* These analyses were suggested by Dr- 
Aaronson, 


—~ Ue Imao 


> ae 


Rorschach Approach Type and Organization 


rs aa were told to write a brief summary 

o E material they had just read. 

abl he hypotheses relating Rorschach vari- 
es and this criterion are analogous to those 


relati : z 
lating Rorschach variables and the previous 
criterion, 


Results 


mane dupe were used to establish agree- 
alternati designating the 80 multiple choice 
ension te es of the 20-item reading compre- 
alternati est as details or generalizations. Each 
two kA was judged to belong to one of 
(D’), TES generalization (G) oF detail 
ments w e means of the six interjudge agree- 
tap ere as follows: G, 77 per cent, and D’, 
significant e All interjudge agreements were 
confidence beyond the one per cent level of 
Ter using x? for 1 df. 
ue agreement on whether or not an 
e ata was true in terms of adhering to 
graphs €rial presented in the reading para- 
aiar eed 79 per cent for the six 1M- 
parisons comparisons, and all interjudge com- 
confidence significant beyond the 001 level 
x ence using y? for 1 df. 
coded o lternatives apparently can be reliably 
tions into correct and incorrect generaliza- 
true and details and also can be coded as 
A not true. 
g ig story recall criterion task, the scor- 
ement for two judges ranged from 80 


Table 1 


tors and Reading Com 


Selected Correlations Between Predic’ 


111 


per cent to 95 per cent for scoring the recall 
of the two generalizations and two details of 
Story 1 (2, p. 28). The agreement was com- 
puted separately for each category VS. all 
other categories and all the relationships were 
significant beyond the .001 level of confidence. 
For Story 2 (2, pp. 29-30) the range of in- 
terjudge agreement was from 65 per cent to 
78 per cent. One of the generalizations could 
not be coded reliably, and, for the second, 
agreement was significant at the .05 level of 
confidence. Coding of both details was sig- 
nificant beyond the .01 level of confidence. 
Clearly Story 2 was less satisfactory for scor- 
ing agreement. One of the generalizations of 
Story 2 was excluded from the analysis be- 
cause interjudge agreement was not statisti- 
cally significant. 

For testing the significance of the relation- 
ships between the Rorschach and the criteria, 
the analysis was done using the tables by 
Mainland and Murray (7) for the median 
test. These tables were used as an approxi- 
mation since one-sided tests seemed appro- 
priate. In addition, for all relationships scat- 


ter plots were made to locate optimum 


cutting points for possible cross validation. 


Where relationships approached significance, 
Pearson correlation coefficients were com- 
puted to permit statistical control of intelli- 
gence by means of partial correlation. 

> of the sixteen relationships predicted be- 


prehension Variables 


Rorschach a le2 
Sample 1 E 
SS 
p 4 : 
Reading comprehension* 3 ti 14 ns. 
= 46 : í 05 
Edo no correct generalizations 28 05 a T 
vs. % correct generalizations 29 05 42 ns. 
4 vs. % correct generalizations _ 30 05 = = 
vs. % correct details 
Vocabulary 49 01 
- 62 .01 4 4 
Vocab, vs. no. correct generalizations 25 ‘05 39 
voor vs. % correct generalizations 33 05 2 05 
el vs. correct details 31 05 R 
V, cab. vs. % correct details 33 05 00 il 
Ocab. vs. Z 


subject. 


* 
% i empted by the 
bat Percentage of correct responses to items of a given category attemp 
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Table 2 


Selected Partial Correlations Between Rorschach Variables and Reading Comprehension 
Variables with Vocabulary Held Constant 


Z vs. % correct generalizations 


Sample 1 Sample 2 j 
Reading comprehension* Partial r p Partial rf $ 
Z vs. no. correct generalizations -35 01 = = 
2 10 21 05 
W vs. % correct generalizations 27 05 = any 
—.28 05 a üa 


W vs. % correct details 


* % refers to percentage of correct responses to items of a given category attempted by the subject. ble 1) 
+ The missing entries were not computed because the zero-order r's were not statistically significant (see Table 1). 


tween the Rorschach and the reading compre- 
hension measures, four of the zero-order r’s 
were significant beyond the .05 level of con- 
fidence in the expected direction (see Table 
1). After partialling out the effects of intelli- 
gence (see Table 2), three of these relation- 
ships were significant beyond the .05 level of 
confidence and one was significant beyond 
the .10 level of confidence. On the cross- 
validation sample only one of these partial 
correlations attained statistical significance. 
Beck’s Z is significantly related to the per- 
centage of correct generalizations of the gen- 
eralization items attempted when Vocabulary 
is held constant. The partial correlations were 
small (.22, first sample, and .21, second sam- 
ple) but statistically significant (p < .10 and 
p< .05, respectively). 

; Vocabulary is related in the expected direc- 
tion to all four of the reading comprehension 
criteria beyond the .05 level of confidence in 
both samples. 

For testing the hypotheses about the rela- 
tionships between the Rorschach variables 
and the story recall, the story criteria were 
inspected independently of the Rorschach 
data for suitable cutting points. For both 
stories, recall of a generalization vs. no re- 
call of a generalization and recall of one or 
more details vs. no recall of details, appeared 
to be meaningful cutting points that were 
near a median split of the population, Tables 
for 2 X 2 tests (7) were used as an approxi- 
mation and where a relationship approached 
significance Fisher’s Exact Test was com- 
puted, since one-tailed tests were desired. 

In all, twenty tests were made (number of 
W, W%, number of [D + Dd], Z, and Vo- 


; d 
cabulary vs. the recall of generalizations Se 
the recall of details for both stories) an 
was statistically significant. Therefore ross- 
story recall task was omitted in the © 
validation study. i hel 

In order to determine if subjects ae 
in the criterion tasks was consistent, the meas” 
relations of the reading comprehension dete" 
ures and the story recall measures were t 
mined. Of ten tests of significance, on- 
were significant beyond the .05 level © liza 
fidence. The number of correct gener v 
tions on the reading comprehension e re- 
significantly positively associated with + 3.05) 
call of generalizations on Story 1 (x ihe 
1, df, p < .05 in predicted direction), t°% sad- 
centage of correct generalizations in t f ge 
ing comprehension test and the recall ‘ r 
eralizations on Story 1 were significa ils 
lated (p < .01), and the recall of oe Wg 
Story 1 was significantly positively tel! 3.40; 
the recall of details on Story 2 (x? absence 
$ <.05 in predicted direction). The ê ay be 
of some of the expected relationships r pis 
due to the rather low interjudge agree™ 
Scoring the generalization on Story 2- rja 
There is some evidence that the ae 
Measuring the same thing, but they ®” jth 
highly related. This finding is congrue” “put 
Goldner’s (4) data which showed 10". of 
Positive interrelations among his meas 
approach in problem-solving tasks. y 


avior 
nte! 


are 
ot 


Discussion 
dnet 


( 
In contrast with a study by Gol hip PE 
there was no evidence of a relations othe! 
tween Rorschach Ap and approach a at 
tasks. The difference in outcome may 


j 


| 


Rorschach Approach Type and Organization 


aie to the kinds of criterion tasks used. 
et used cognitive tasks such as the 
study locks, anagrams, etc., whereas this 
Perlu employed meaningful verbal material. 
ae ee Ap is related to behavior in ap- 
the re some kinds of problems, but not to 
verbal prehension and recall of meaningful 
a Only Z was found to show 
domain. or predicting performance 1 this 
a Z gives more weight to the qualitative 
gories, p performance than the location cate- 
more , Perhaps future studies should focus 
rs ails qualitative aspects of Rorschach 
would a For research of this sort, it 
he seagate to use the individual 
easible = since a more thorough inquiry 3 
Nother an when using a group technique. 
administ advantage of using the individually 
Wo A is the greater podia? 
echnique, etails (6) than in the group 


Thi Summary 
vbothe 7 was undertaken in order to test 
€ or ses about the relationship between 
the eee ation of the Rorschach stimuli and 
Ple ene of cognitive material. A sam- 
and st 3 subjects seeking help for reading 
R ag skills was given the Diagnostic 
Stoup g Test, Survey Section, Form B, 4 
tum and a free recall task. / 
Siven n datio sample of 69 subjects was 
call tisk same battery excluding the free re- 

« The The findings are as follows: 

relating oe is no support for the hypotheses 
€tms of orschach approach and thinking in 
a Struct generalizations or details usin& either 
ured or an unstructured cognitive task. 
here is evidence that Z, & measure 0 


Oganizati 
Nizational activity on the Rorschach, 3 
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related to selecting more highly organized re- 
sponses in a structured cognitive task when 
intelligence and speed are controlled. 

3. When compared with the Rorschach 
variables used in this study, vocabulary, an 
intellectual measure, is a better predictor of 
choice of relevant details and generalizations 
from irrelevant generalizations and details re- 
gardless of whether speed is controlled. 

4. Neither the Rorschach variables nor Vo- 
cabulary predicted the free recall of generali- 
zations or details from story material. 

5. There is some evidence of consistency in 
the part-whole approach among verbal tasks. 


Received June 23, 1955. 
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The Relation of Rorschach Indices of Extratension — 
and Introversion to a Measure of Responsiveness 
to the Immediate Environment’ 


Lester Mann? 
Camden Area Mental Hygiene Clinic 


One of the basic assumptions underlying the 
Rorschach test’s indices of extratension and 
introversion is that the former are indicative 
of an orientation toward the environment and 
the latter of one away from it and toward the 
self. An accumulating literature has come to 
support this assumption (6, 8, 10, 12, 13, 14). 

The present research is an attempt to con- 
tribute further to its validation through the 
test of a logical corollary. Assuming that ex- 
tratension is characterized by responsiveness 
to the immediate environment and introver- 
sion by a lack of such responsiveness, the in- 
vestigation sought to demonstrate relation- 
ships between Rorschach E-I indices and an 
operationally defined measure of responsive- 
ness to the immediate environment. 

The following Rorschach E-I indices were 
selected for study: M, C Total, € Sum, M:C 


are those originally proposed by Rorschach 
(11); the latter three were later evolved by 
Klopfer (7). 


The criterion measure of responsiveness to 
the immediate environment was operationally 


1 This article is based on a dissertation submitted 
in partial fulfillment of the requirements for the de- 
gree of Doctor of Philosophy, University of North 
Carolina, 1953. The major part of the investigation 
was carried out while the writer was a trainee in the 
VA Clinical Psychology Training Program. The guid- 
ance of Drs. Harry W. Crane, Joseph G. Dawson, 
and Dorothy Terry, members of the writer’s thesis 
committee, and Dr. B. J. Winer, who acted as sta- 
tistical advisor, is gratefully acknowledged. 

2 Formerly at the Mental Hygiene Clinic of Raleigh 
and Wake County. 


My 
defined in terms of words referring to a 
mediate environment written in the Bin ts of 
sociation task. The Binet task ane te e 
having a subject write a list of words i 

experimentally controlled conditions sapor” 
determining, through inquiry, their g ing 
referents, It is assumed that words Te. yve 


tiv 
to the immediate environment are ince 
of responsiveness to it. It is further a mea 
that the number of such words ogee (2) 
ure of the degree of responsiveness. the task 
employing the original version pee Mat 
with his two daughters, found t a larg? 
guerite, clearly an extrovert, gAV iat ut” 
number of references to her immet provet 


roundings; conversely, Armande, an a riti 
gave few such references. For a seade is 
cal appreciation of Binet’s work, the (5) f 
referred to Goodenough’s discussion jon ° 
fuller exposition of the writer’s adapt2 ^ sjse- 
the Binet technique has been pieri ac 
where, together with a rationale a an OP” 
ceptance of the criterion measure roverso 
erationally defined measure of ex 
introversion (9). 

The general hypothesis of the S 


was 
tudy i (10° 


Rorschach indices of extratension ap gute 
version are related to the criterion enviro™” 
of responsiveness to the immediate e 
ment. er 


es 
The following specific hypothes ; 
tested: ion, 1°? 
1. Rorschach indices of extratens™ tivelY 
C Total, C Sum, Fe + c + C', are P 
related to the criterion measure. 


ap ies 
a jon, 
2. Rorschach indices of introvers 


114 


=F 


ki 


nm 


Rorschach Indices and Responsiveness to 


M : 

2 FM +m, are negatively related to the 
criterion measure 

3.: UT E i 
aoe ratio indices of extratension- 
if hoe, i.e., M:C Total, M:C Sum, FM 
the ‘Fe +c-+C', are negatively related to 
criterion measure. 


Procedure 


on periment was conducted in a small 
adjacent b a single window through which 
Oises co ee and trees could be seen. 
oth witht be heard from outside the room, 
Lier ae without the building. The 
a bidkoee tore with a table, three chairs, 
Magazine a holding several objects, and a 
ered on and with a few magazines scat- 
equipment it. These articles were its original 
sion of co and, to avoid any possible impres- 
Way, ntrivance, were not altered in any 

T 
Ta ae students served as sub- 
individually experiment which was conducted 
aSsociatio y. Two administrations of the Binet 
Son, Th n task opened the experimental ses 
final be, Rorschach test was then given. A 
ee of Hie Binet task fol- 
- Standard sets of Rorschach inkblots 


Were e 
numh mployed for the test. Sheets of Papers 


e Š 
> a vertically from one through twenty- 
tage "4 pen were provided for the Binet 


The p 
“W, as. fonnistrative procedure for the Binet task 
i vento The subject was first instructed, 

ey Yy-five words, any twenty-five words 
choi completed o to mind, Write no sentences.” The 

Oice of ed, the subject was questioned as to his 
tr S ote. ords. “What did you have in mind when 
Mina word? What made you write it?” 
jee Teter n remained as to a word’s exact tem- 
wee pn the examiner asked whether the sub- 

‘ote it, anything particular in mind” when he 
a The R 
Ccordan 


(7). 


on test was administered in general 
Ai the procedure outlined by aon 
ot a of ten responses was allowed or 
to insure completion of the test within 

8 ei period. 
nets in the f (1) was used to score the cee 
dicen er's (7 e E-I indices formulated by Rorschac ' 
unde = ime to score the determinants 1m the in- 
tl ioe Certain responses a 
Were eon system but FM 
e Credited, cases both M and 


Beor, 2 
ekg H 


Min, 


e score 
or m under the 


FMt+m indices 


ule Percept involved multiple determinants, 
(1) was followed and multiple credit as- 
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signed, i.e., all determinants were equally scored. The 
one exception taken to the rule was in the circum- 
stance of determinants composing the same index, 
eg., only one score would be credited to the index 
FM +m on the basis of a percept involving both 
animal and inanimate movements. It was felt that 
multiple scoring in such cases would overcredit the 


index. 


A total of seventy-five words were obtained 
through the three administrations of the Binet 
association task. These were analyzed to de- 
termine the number that referred to the im- 
mediate environment. The latter constituted 
the criterion measure. 

The sole basis for inclusion of a word 
within the criterion measure was that of ref- 
erence to the immediate environment; to any 
aspect of it and in any manner whatsoever. 
The immediate environment was defined as 
extending the entire experimental period, i.e., 
ent the subject entered the ex- 


from the mom 
perimental room to that of his completing the 


assignment. Examples of references to it are 
words referring to the room’s furnishings, to 
sounds coming from without the building, to 
the subject’s physical states at the time of 


the experiment. 


Analysis of the Data 

Chi square and tetrachoric r were the sta- 
tistics employed in the investigation. These 
counting procedures have been recommended 


for use with Rorschac 


ie ity of test units (4)- 
aS computed with corrections 
y. One-tailed 


for continuity where necessa" 


all instances. 
crucial for rejection of t 
The Thurstone 

were employed to 
transformation was used t 
and to test the significance © 
he a atal treatment required the rank- 
order distribution and dichotomization of the 
‘experimental variables. The latter was car- 
ried out to achieve, aS closely as possible, an 
equal division of the distributions into high 


o average the latter 
f differences be- 
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and low score groups. If several ties appeared 
at a distribution median, they were assigned 
to either group as best approximated equality 
of division. If but two ties appeared at this 
point they were randomly assigned, one to 
each group. 

In considering the total group of subjects 
certain of the Rorschach E-I indices were 
found significantly related to Ry kë WM, C 
Total, Fm + m and Fc +c + C' are related 
to R beyond the .05 point for the total group. 
A procedure recommended by Cronbach (4) 
was employed to control this factor. These 
indices were studied, as regards their relation- 
ship to the criterion measure, within two sub- 
groups formed, on the basis of R, from the 
total group; a kigh R group, consisting of 
twenty-four subjects, with R ranging from 


Lester Mann 


forty-eight through one hundred, and aA 
R group, comprising twenty-six subiera 
with R ranging from twenty-three throi | 
forty-six. Their relationships to R are 
significant within these subgroups. f the 
In order to obtain over-all estimates 0 an | 
relationships of M, C Total, FM +™, 
Fc + c+ C to the criterion measure ie 
total group of subjects, the results obta 
from the subgroups were combined, ane de | 
x"’s added, with their significance being he | 
termined for two degrees of freedom, a” tjon | 
r’s averaged through the z aii 
Those E-I indices not significantly ea. 
R in the total group, i.e., C Sum, M:C | 
M:C Sum and FM + m:Fco+¢+ me nship 
studied directly as regards their relatio 


‘age $ S e tot 
to the criterion measure, i.e., in th 


Table 1 . 


Summary of Rorschach and Criterion Measure Data 


fi E 
Variable Mean Range SD Divisionțt a 
Total group 
R 54.16 23-100 26.63 4 
M 7.88 0-32 5.98 24-26 2.93" ts 
C Total 7.88 1-18 4.86 24-26 4.16" ga 
C Sum 6.53 5-17.00 431 25-25 123 pl? 
M:C Total 1.76 0-17.00 134 25-25 53 407 
M:C Sum 2.44 0-34.00 4.94 25-25 0. eet 
FM+m 11.7 2-37 6.62 25-25 502% 473 
Fe+c+C' 8.04 1-39 6.18 26-24 8.03 3.07 
FM+m:Fe+e+C! 2.07 .25-8.00 1.59 25-25 0 
Criterion 22.63 0-66 15.71 
High R group 
R 77.75 48-100 18.65 +% 
M 10.42 0-32 7.38 12-12 Ad 95 
C Total 9.79 1-18 5.20 12-12 —t 4.02 
FM+m 7.14 5-37 7.03 11-13 00 00 
Fete+C' 5.38 2-39 5.84 12-12 W 
Criterion 25.25 0-66 16.58 
Low R group 
R 32.38 23-46 7.42 +o 
m 5.54 1-12 265 13-13 J00 460 
C Total 6.12 1-14 374 13-13 2 pi g 
FM+m 9.71 2-20 4.49 14-12 D p% 
Fe-+c+C! 3.42 1-13 5.12 14-12 1.0 
Criterion 20.19 2-56 14.45 


Rorschach 


Indices and Responsiveness to Environment 


dif 


Table 2 
The Relation of Rorschach E-I Indices to the Criterion Measure 


Combined results 


Total group Hi 
gh R group Low R 
Rive w R group of subgroups 
et ct cat % i 
T x rr agt. x? ry agt. x Ti Ked x? m 
agt. 3 r, agt 
C Total 4.17* 75 5 
r —.71 75 15 — 

oe 17 5 15 -12 54 6.15* —.45 64 
MC Total 5.12* +.54 68 a oe se a Le A 
ene UE IAS 

D m 4.00 — a 
Petece 3 5 

feu 31 —.24 58 —t +13 46 5 

5 1 24 2 AS d 

leRebese aa Et G 417 +71 75 —t —13 46 5.67* o 2 

Note.—. 

f freedom. x?'s for the combined results of the sub- 


Brou, x?'s fo 
ype are based. total, high R, and low R gr 
sa Significa! on two degrees of freed 
Sign acant at the .05 point.” penge 
met% of si ant at the .01 point. 
easure, ubjects in pami, 
y group whose results are in agreeme 


that The y2's á 
Drediceed ted Tor the relationships © 
‘or both indices x? was .08. 


Stou; 
> Up per ` 
instigate d se, without controls for R being 


abl 
data na Presents a summarization of the 
Stoups, ag in the total, low R, and high R 
Various y, e means, ranges, and SD’s of the 
erein, aa distributions are presented 
h Significance and of their division for tests 
e relatio 3 and estimation of correlation, 
R. nship of Rorschach E-I variables 


Results and Discussion 


The 
Tes 7 
Presented r investigation proper are 


the T 

total btn, indices studied directly in the 

and ae of subjects, C Sum, M:C Total, 

Measure Sum are related to the criterion 
fashion 


= null hs statistically significant 
+ ypothesis is sustained in the case 
None Bg Hete. 
tups ar He E-I indices studied in the sub- 
n Sie Significantly related to the cri- 
-M a in both high R and low 
t set Be +c+C demonstrate S18- 
atter pee in the former but not in 
ti ormer — in the latter but not in 
fatment | M + m in neither. However the 
bj > specifies these indices in the subgroups 
neq Sete to control for: Re The co 
ts, from the subgroups offering 


of 


hific 
fhe 


oups are based on one degree of 


nt with hypothesized relationshi 


í FM +m and Fe+e+C" 


pof Rorschach E-I indices to the criterion 


to the criterion measure were in a direction opposite to 


over-all estimates of the relationships to the 
criterion measure for the total group of sub- 
jects, are regarded as the crucial ones for the 
experiment. They permit rejection of the null 
hypothesis for M, C Total, and Fc + ¢ +C 
while sustaining it in the case of FM +m. 
None of the statistically significant results 
was significantly different from the others. 


Summary 
A study was carried out with fifty subjects 
to test the assumption that Rorschach indices 
of extratension an re indicative 
of opposed orientations towards the external 
t. Assuming that extratension is 
characterized by responsiveness to the im- 
mediate environment and introversion. by a 
attempt was 


lack of such responsiveness, an a 
made to elationships between 


demonstrate " 
Rorschach E-I indices and an operationally 
defined measure of responsiveness to the im- 
mediate environment. 

The Binet association task furnished the 
latter measure. The subjects were required to 
write, On three different occasions, the first 
twenty-five words that came to mind. The 
number of these words that referred to the 
immediate environment formed the criterion 


measure. 
The following Rorschach E-I indices were 
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found significantly related to the criterion 
measure at and below the .05 point of sig- 
nificance: M, C Total, C Sum, M:C Total, 
M:C Sum, Fc +c + C'. The null hypothesis 
was sustained for the relationships of FM + 
m and FM + m:Fc+ c+ C'. None of the 
statistically significant relationships was sig- 
nificantly different from the others. 


Received June 30, 1955. 
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Ro 
Ship tn (5) implied a triadic relation- 
tion, and g motor behavior, motion percep- 
did not ak cage processes. Although he 
empirical ot a theoretical rationale for his 
erent orje servations, theorists of rather dif- 
tonships | a have postulated similar rela- 
Onic theo erner and Wapner’s (11) sensory- 
eoretical by of perception has provided a 
tween t asis for the vicarious relationship 
activity hey members of this triad—motor 
eet see liemanar perception. Studying sen- 
Orschach 1eory within the framework of the 
7 ave situation, previous experiments (2, 
e neo the inhibition of a motor act 
man m wed by an increased production of 
Withee ce (M) responses. Further, the 
Ieally ae that individuals who are motor- 
tinier ne tend to produce fewer 
i responses than those who are less 


active h: 
8, 10), as been supported experimentally (6, 


A th 
areas 
activi oretical link also exists between motor 


y, Hd and cognition. In psychoanalytic the- 
Seconda gradual shift from the primary tO the 
trol of ty process involves the delay and con- 
tion of Impulse expression, an the substitu- 
thinkin symbolization, fantasy; an 
of ianed “experimental actio 
Bbapors ce response on a beh 
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dition underlying the devel- 
antasy and thus thinking. 
aper (1) dealing with cog- 
nitive behavior at the level of the formation 
and inhibition of associations, We have shown 
that the ability to inhibit an habituated ac- 
tivity at the motor level (writing a phrase as 
slowly as possible) is directly related to the 
ability to inhibit Jearned associations. Those 
Ss who were able to slow their writing down 
for the longer period of time were able to 
inhibit learned associations and substitute 
new ones for them more quickly than were 
poor motor inhibitors. Other studies (6, 9) 
have shown relationships between the percep- 
tion of M 0 


the primary con 
opment of early f 
In a previous p 


n the Rorschach, motor inhibition, 
TAT stories, and 


measure general 
d cognitive inhi- 
further support 
among motion per- 


jnhibition, and cognitive proc- 
i e it shown that 


pl 


associations. 
The Experiment 

A direct relationship between 
of Rorschach human move- 
and the ability to inhibit as- 
othesized. It is proposed that 
kinesthetic factors on 
better able to inhibit 
who are less percep- 
t in the inkblots. 


H ypothesis. 
on 


e sensitive to 


the Rorschach will be 
than those 


tive of human movemen! 
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clinical testing. From this vantage point, with 
access to case history material, our observa- 
tions suggest that the techniques used in this 
and the previous study do actually reflect the 
degree to which strong impulses or affects are 
characteristically controlled in the process of 
avoiding conflict with society. These impres- 
sions, of course, require experimental verifi- 
cation. 


Summary and Conclusions 


This experiment was designed to test the 

hypothesis of a direct relationship between 
the production of human movement (M ) re- 
sponses on the Rorschach test and the ability 
to inhibit associations. Ninety-three Ss were 
administered the Rorschach and a task de- 
signed to measure the efficiency of cognitive 
inhibition. The Ss were divided at the median 
into High and Low M and M% groups and 
these groups were then compared for cog- 
nitive inhibition time (CIT). Analysis of the 
results warrants the conclusion that indi- 
viduals who are more responsive to kinesthetic 
stimuli in the Rorschach are better able to 
inhibit associations than are those who are 
not productive of M responses. 
f When these findings are considered in con- 
Junction with those of previous related stud- 
jes, they lend further support to the triadic 
hypothesis interrelating motor behavior, mo- 
tion perception, and cognitive processes. 
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Actuarial Prediction 


Robert D. Wirt 


University of Minnesota 


M 

i (2) has pointed out the generally 
appears ean which statistical prediction 
iction of Reve relative to the clinical pre- 
ture for havior. In his search of the litera- 
to Rete Gee data which could be used 
Statistical e the relative power of clinical vs- 
few a prediction, he was able to find only 
Rans oe studies. The present 1M- 

ata { represents such a comparison. 
Were yg e an earlier study by the author 
k Sa (3). In that study it was found 
fully aon s Ego-Strength scale (1) success- 
tients a hospitalized psychiatric Pê- 
Psychother had shown great improvement in 
Tove, sl from those who did not im- 
ne te nit by the patients’ psychiatrists. 
ounts 7 of clinical vs. statistical prediction 
Psychom, o the difference between running 
“€pting etric data through a machine and ac- 
selection f actuarial cutting line from which 
tunning or treatment will be made as against 
Mtuitiye the same test results through the 
© then psyches of one or more clinicians 
ent stud make similar selections. In the pres- 
‘ek the 19 patients who were rated as 
greatly improved as 2 result of 4 


short 
of sera, of psychotherapy from 4 total 
Psychiatr; consecutive admissions to & neuro- 
ric hospital were matched for age, 
Table 1 
Composition of the Sample 
i Greatl Unim- 
M Stile arava proved 
can ape ; 
Mean ae in years 28.5 32.5 
mean 10° of hospitalization 38.5 39 
Sdian Z 124 105 
‘i aR 50.5 37.5 


Table 2 
Clinical Sorts of the MMPI Profiles 
Number of 
correct 
judgments 
Judge (W=38) x 
A 16 95 
B 22 95 
CG 20 10 
D 22 95 
E 26 4,90* 
F 20 10 
G 20 .10 
D eee 


*p = 04. 


days of hospitalization, and diagnosis with 19 
patients who were rated as unimproved by 
their doctors. The composition of the sample 
js shown in Table 1. Most of the traditional 
diagnostic categories were represented, with 
most cases being classified among the neu- 


roses. AS the data in Table 1 suggest, there is 
a positive relations and Es 


hip between 
score. This is consistent with Barron's find- 
ing. The MMP 


d for the usual 
four validity an 


chotherapy. The re- 


d not im 
would n p hown in Table 2, 


dgments are S 
or wishes to express his appreciation to 
erstadt, Starke R. Hathaway, Rich- 
ard C. Kogl, Paul E. Meehl, John J. Regan, Albert 
William Schofield, and Mr. Arthur J. Gallese, 


vere the judges in this investigation. 
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where it will be seen that only one judge ex- 
ceeds chance at an acceptable level of sta- 
tistical confidence. 

The Es scale values for these groups mis- 
classify four individuals in each direction, if 
the median of the total sample is used as the 
cutting line. Thus the number of correct judg- 
ments for the mechanical sorting would be 30, 
which gives a chi-square value of 12.73, the 
probability of which is less than .001. In this 
situation the use of mechanical sorting clearly 
beats clinical prediction. 


Discussion 


Service psychologists frequently are asked 
to make recommendations for treatment. It is 
a matter of very great personal and economic 
importance to them and their patients that 
their predictions be accurate. If results such 
as those described here are indicative, it might 
be by far in the best interest of patients to 
devote our time and skill to the develop- 
ment of refined actuarial and mechanical pro- 
cedures. However, it should be remembered 
that what is here called “clinical” is not by 
any means what most psychologists would 
mean by that word. Meehl implies that such 
examples as the one given here can be used 
to compare the clinical with the statistical 
approach. As a matter of fact, in the prac- 
tical situation most psychologists make their 
recommendations for treatment upon psycho- 
metric data, as used in this investigation, to- 


Robert D. Wirt 


gether with social history, medical data, intet- 
view material, and observation of the patient. 
An appropriate test of the difference in powel 
between the two approaches would be to have 
clinical predictions made from total psycho- 
logical examinations; these to be pear 
with actuarially derived measures such as t 
Es scale. 

A further word should be said abo E 
base-rate problem in prediction. In the “et 
ent investigation the situation pasate 
the judges was a gross distortion of the io 
rates of recovery following psychotherapy is 
the hospital population used. Of 225 p e 
treated by psychotherapy alone, only 19 ‘dges 
were rated greatly improved; but the JU 
were given the problem of selecting coe a 
from an N of only 38 cases. The real re 
the clinician, or of the machine, in a ong e 
situation would be to identify the good tion: 
for psychotherapy out of the total populat® 


ut the 


A stl 
The Es scale in the study cited could be 
competition for a clinical approach. 
Received July 26, 1955. 
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Veterans Administration 


0 
ie ane hospital treated and discharged 
erculous ousand veteran and military tu- 
military Da sali in 1952. Both veteran and 
ospital co poe were treated under the same 
staff, Of = itions and by the same medical 
Were treat T military patients, 98 per cent 
active) an successfully (disease rendered in- 
. Of the veteran patients, only 33 per 


cent y 
ent were treated successfully. This marked 


Mer 
en * 
ce between the two groups in success 


tre, 
atment for tuberculosis M4 


a 


tof t 


IS 
Charge of 47.8 per cen 
f their physicians 


grou 5 

(6). against the advice 0 

Thi 
she datum typifies wha 
ene in the succe 
the pati trol of tuberculosis, that of keeping 
is com ae in the hospital until his treatment 
one-half eted. Every year, f ird to 
Pitals Je of the patients in 
vice (6 8). the hospital against ™ 

if ; 
Neina years, a growing 1 
ar dis studies of the problem of “irregu- 
Medical arge” (leaving the hospital against 
aS pro advice) have appeared llen (8) 
vided an excellent revie 


Te 
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sin ted prior to 1948. Repres¢ 


t has become the 
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umber of ex- 
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the potential 
m other hos- 
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Hospital, Houston, Texas 


proposes to ex- 
he patients’ (a) 
, (b) prehospital life ad- 
attitudes towards situations in 
(d) behaviors in the hospital, 
utside-the-hospital situa- 
or lack of success in re- 
maining in the hospital until his treatment is 
completed. For purposes of analysis, it is hy- 

thesized that @ high level of adjustment in 
areas is associated with success- 
of hospital treatment. A for- 
f the hypotheses to be tested 
d in the section on results. 


nvestigation 


The present i 
ship of t 


Jation 
family of or 
justment, (c) 
the hospital, 
and (e) current 0 
tions, to his success 


mal state! 

is provide 
Method 

al data were obtained from 140 

ns who were currently receiving 

r tuberculosis in a large Veterans 


GM&S hospital. The sample 
rom each of seven 


t stages of 


The initi 
vetera 


he installation, 


d not ĉ nd 40 who were too 


att 
the initial 


who woul 


regular discharge 
atient had successfully 
addition to these cri- 
uals with a 
scharges were eliminated 
hus, six patients were ex- 
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cluded who had received a discharge in the 
past that was the opposite of their current 
discharge. Of the 140 subjects interviewed, 
39 met the criteria for regular discharge and 
19 met the criteria for irregular discharge 
within the nine-month period? 

Information concerning the patient’s past 
life adjustment and current outside-the-hos- 
pital situations was obtained through struc- 
tured interviews with the patient. The data 
concerning the patient’s adjustment to the 
hospital encompassed his attitudes toward the 
institution and his ward behavior. The former 
was obtained through interview, the latter 
from behavioral ratings by nurses and aides. 
Owing to the nature of their illness, each pa- 
tient was seen for not more than thirty min- 
utes at any one time. The number of such 
interviews varied from four to seven, depend- 
ing upon the patient. All responses were re- 
corded on data sheets while the interview was 
in progress. In the account to follow, a brief 
description of the content and the method of 
scoring each measure is provided.* 


Measurement of Prehospital Life Adjustment 


A life adjustment scale was devised, com- 
prising 132 items of information which cov- 
ered nine areas of living.* Here the cardinal 


discharge rate during this period. However, the fur- 
ther reduction of expected cases, not accounted for 
by the lowered irregular discharge rate, throws light 
on a hitherto little appreciated aspect’ of the irregu- 
lar discharge problem, the implications of which are 
developed in the Discussion section. 

3 The complete interview schedules and examina- 
tion forms, together with scoring manuals, have been 
deposited with the American Documentation Insti- 
tute. Order Document No. 4741 from the ADI Aux- 
iliary Publication Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $3.75 for photoprints or $2.00 for 35 
mm. microfilm. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 

4In the construction of this scale we borrowed 
ideas freely from many published scales. Our great- 
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principle was to cover comprehensively E 
requiring adaptation in the patient’s life. ia 
items dealt primarily with factual intor 
rather than with attitudes or judgments. T a 
a patient was not asked about his atia 
toward job, peers, parents, etc., but "held 
such questions as the number of jobs al 
number of close friends, amount of time 
parent was home, etc. 


The 
Briefly, the areas covered were as pare 
family background scale, composed of the “es 
five subscales: (a) parents’ economic at d) 
parents’ education, (c) parents’ oer cerid 
completeness of family life, i.e., items curity 35° 
siblings, parents’ marital status, etc., (e) es par- 
pects of early life, e.g., who raised the pa 1 adjust- 
ents’ time at home, etc. B. The educational 


ing gr% 
ment scale consisted of items encompass to peers 


covered childhood, ow and a 
vior, relationships with peers, erne! 
ie etc, D. The health scale was Co mount 
with childhood, adolescent, and adult See was 
of medical attention, etc. Æ. The driten, alcoho c 
concerned with the amount and type "a The 1% 
indulgence in adolescence and adulthood. ' d adult 
ligion scale covered childhood, adolescen tment scale 
church attendance. G. The army 2) acars, gai? 
dealt with relationships with peers and E scale was 
in rank, etc. H. The occupation adjustiney id in P 
concerned with job level, number of jobs e ma 
5 years, reasons for leaving a job, etc. J. number í 
adjustment scale included marital status, i g of chil- 
marriages, number of children, disciplini 
dren, etc, , adjust 
Scoring. After all items of the ite je re- 
ment scale had been selected, each p Se rior! 
sponse to an item was ranked on or score 
basis from least to most adaptive. m was It 
for each possible response to an ite j espons? 
rank position, with the least ny response 
receiving a score of zero. Thus, t wpilities re 
to an item with two response possibi with 
ceived scores of zero and one. AD nates of 
three response possibilities Fe items: 
zero, one, two, and so on through t t numbel 
To prevent items with the greai jnfluen” 
of response possibilities from unduly £6 ach 
ing the total scale score, ag cng ger? 
item were then rescored on a scale respo”! 
to nine. Thus, an item with E ee equ? 
divided the zero to nine scale into thr 


A 
e jal Atta” 
est single debt is to Leslie Phillip’s Socia! 
ment Scale (3). 


Z: 


d 
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red be the two alternatives received scores 
zero to 6- A three-response item divided the 
a nine scale into four equal units and 
45 = alternatives received scores of 2.3, 
scales w ; .7, respectively. All items on the 
the s ere so rescored. Any scale score was 
um of the items comprising that scale. 


Me 
asurement of Current Hospital Adjustment 


caer scale. An attitude scale was de- 
tive ikem an attempt to provide a quantita- 
just ure of each patient’s attitudinal ad- 
c ment to the hospital. The attitude scale 
Omprised 45 it P 2 

Stituting im items that were selected as con- 
uberculou portant adjustmental problems for 
Were a The problem situations 
Structured ished by means of extensive un- 
domly sel recorded interviews with ten ran- 
Pilation ected tuberculous patients. A com 
tuted at patient statements consti- 
Were or e initial set of items. These items 
flowin ed on an a priori basis, into the 
tegulatio, areas: (a) attitudes about ward 
attitug (b) attitudes about personnel, 
es ab es about other patients, (d) atti- 

l out hospital facilities. 
statement items were couched in terms of 
Ortang S, eg., “Bed rest is the most 1m- 
view p Patt of treatment.” During the inter- 
e a statements were read to the patient. 
of the ei Was instructed to respond in one 
tidra S four ways: strongly agrees 
atel Sy agree, strongly disagree, moder- 
"ecorde Sagree. The patient’s responses were 
ttity — a data sheet during the interview- 
Enters on scale scoring. First, the exper 
ent or a a judgment as to whether agree- 
“ould disagreement with a particular item 
Prolon, e considered least or most adaptive to 
S aa hospitalization. The response 0 
depen ‘lent was then scored as 0, 1, 2, oF 3, 
Its a ro on the intensity of the ‘attitude and 
Sidere Ptive directionality. Thus, 4? item con- 
teceiyeg Ptive in the direction of agreement 
Agree — the following scores: strongly dis- 
ately ag 9, moderately disagree = 1, mo er- 
; Stee = 2, strongly agree = 3, Each e 
th i ae oe we valles 


` 3.6, 5.4, and 7.2, respectively- 


1zi 


score for any area was the sum of the items 
comprising that area. 

Behavior rating scale. The guiding motive 
in the construction of the behavior rating 
scale was to obtain a comprehensive descrip- 
tion of ward behavior. The primary criterion 
for selection of a specific item was that it de- 
scribed an activity, a plainly observable ac- 
tion, on the part of the patient. In the col- 
lection of such items an explicit effort was 
made to suspend temporarily judgments of 
the relevancy of the item to prediction of ir- 
regular discharge. 

Initially, about 80 such items were derived 
from the knowledge gained through informal 
observation over a year’s time of the day to 
day living of patients on seven tuberculosis 
wards. After a series of preliminary tests for 
clarity and “ratability” of items, the behavior 
scale was reduced to the present 64 items. 
This array of items was then re-examined 
and grouped on @ rational basis into behav- 
ix areas of hospital adapta- 
were: (a) regulations to 
, (b) regulations to 
protect the health of others, (c) personnel, 
(d) other patients, (e) hospital facilities, (f) 
interaction with people outside hospital. 

Behavior rating scorns. ‘Here again, the ex- 

eins made an a Ee a 

a icular observa i 
whether 4 at re EO prolonged hospitali- 
urses and two aides, 
tended the patient for sev- 


only two alternatives which 

took the generic form of reap t: doniey 
sehavi ively. An 1 

or not behaving adaptively: An he fou 


i jng manne! 2 
storen ii be TR tive alternative the 


the four 
alternative the 


the adaptive alterna 
one rater checked the adaptive al 
was one if no rater 

scone alternative the score was zero. The zero 
i five scores Were then placed on : 

i igned scores of 1. 

:ne-point scale and assigned — : 
ne: 0, and TeS; respectively. The pa- 


4.5, 6. 
m core for any area was the sum of the 


tient’s sc 
ising that area. 


items comp" 
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Table 1 
Comparison of Regular and Irregular Discharge Groups on Prehospital Life Adjustment Scales 
(N = 58)* 
Regular Irregular 
Scale Mean SD Mean SD t n 
Area of family background 126.53 13.81 127.31 15.81 sie = 
Parents’ economic status 24.21 3.72 24.37 3.57 = 2 
Parents’ education status 6.62 2.62 7.21 2.55 =F a 
Parents’ occupation status 15.85 3.61 16.42 2.61 rae = 
Completeness of family life 29.36 6.42 29.89 7.25 = <.50 
Security of childhood 50.49 5.63 49.42 7.85 53 
Area of education <.20 
Attainment 3.72 1.47 3.26 1.05 1.06 <0 
Grade school* 37.50 5.62 33.47 6.88 2.20 <10 
High school* 28.88 5.10 24.67 5.95 1.55 2.05 
Area of social relations 107.24 11.36 101.18 12.11 1.83 2.30 
Childhood 38.49 3.61 37.47 3.78 98 <.05 
Adolescence 31.60 5.14 29.20 4.82 1.75 <10 
Adulthood 37.15 5.14 34.51 7.26 1.43 — 
Area of health 50.65 5.76 50.68 6.64 = = 
Childhood 21.72 2.88 22.58 2.61 = — 
Adolescence 13.90 4.21 14.20 6.17 = <20 
Adulthood 15.03 2.88 13.90 3.38 1.22 <05 
Area of religion 16.62 2.85 15.00 3.30 1.84 <40 
Childhood 6.21 84 6.00 1.08 15 <05 
Adolescence 5.56 1.45 4.84 1.70 1.81 <05 
Adulthood 485 135 4.16 1.30 1.97 <.20 
Area of drinking 25.36 3.13 23.89 4.54 1.28 <0 
Adolescence 6.92 82 6.47 1.43 1.25 2.00 
Army 608 1.14 5.68 1.33 1.08 <30 
Adulthood 5.92 1.68 5.42 205 93 <.80 
Last six months 6.44 1.46 6.32 1.98 23 <0! 
Area of occupation 52.44 9.69 46.06 9.90 2.32 2,80 
Childhood 4.41 1.40 4.37 94 13 2.30 
Adolescence 2.90 1.37 2.58 1.27 89 <0 
P Adulthood , 45.13 8.29 3911 996 2 4 <0 
rea of the military 52. 2.0 
Area of marriage mae uss 48.47 et <.20 
oe 5.77 2.46 4.89 2.92 1.13 - 
SEPA, 41.53 6.20 41.86 4.23 = 


* Grade school, high school, and family life subscales we i ively. 
school, 1001, il re computed with N's of 55, 22, and 48, respective 
tp values are for one-tailed tests, No b value was ascertained for means AEREE reverse directionality. 


All 
, á 5 : Ss. 
Measurement of Situations External to the same manner as the life adaptation item xed 


Hospital Possible responses to each item oo os! 
From the unstructured interviews with ten 0M an a priori basis from the leas sible n 
patients and from discussions with staff mem- adaptive. The score for each P ition, wit 
bers, 20 specific problem situations were iso- Sponse to an item was its rank pos a core 
lated. These were then formulated into 20 the least adaptive response Seen e the” 
items comprising four areas. These areas were: of zero. The responses to each item si d 
(a) patient’s future employability, (b) pres- rescored on a scale from zero to ni placed 
sure from others to continue treatment, (c) All scales used in the present stu A prio? 
current economic status, (d) other family re- each response to every item on n served 
sponsibilities, i.e., children, family illness, etc. nine-point scale. Such a scoring syste he Jeast 
Scoring. The 20 items were scored in the several purposes. First, it preserve 


fo most adaptive directionality. Secondly, 
each item contributed equally to the total 
score. Finally, all scale scores were independ- 
ent of the empirical distribution, thereby 


Simplifying replication of the study. 


Results 

ao hypothesis may be stated as fol- 
eee rregular discharge patients when com- 
Peia regular discharge patients will 
of livi emonstrated poorer adjustment in areas 
losis T prior to hospitalization for tubercu- 
was able 1 indicates that this hypothesis 
onn age at the 5 per cent Jevel of 
ions oN in the areas of: (a) social rela- 
e oe religion, (c) occupation, and (d) 
Ported i ary. The hypothesis was not sup- 
(b) he : the areas of (a) family background, 
iewed th, (c) drinking, and (d) marriage. 
e irre developmentally, Table 1 shows that 
Poore Bular group demonstrated significantly 
r adjustment than the regular group 1? 


Determinants of Treatment of Tuberculosis 


129 


in social relations and religion 
occupa- 


grade school, 
during adolescence, and in religion, 
tion, and the military in adulthood. 
The second hypothesis stated: Irregular dis- 
charge patients when compared with regular 
discharge patients will demonstrate poorer ad- 
justment to situations within the hospital. 
Table 2 indicates that this hypothesis is 
not supported in terms of the expression of 
attitudes toward ward regulations, hospital 
personnel, other patients, and the facilities 
offered by the hospital. However, Table 3 
indicates that the second hypothesis is sup- 
ported when the ward behavior of the two 
groups is compared. In all six areas measured 
he predicted direction. 


the behaviors are in t 
A further examination of Table 3 indicates 


that specifically the irregular discharge group 
demonstrated significantly poorer behavioral 
adaptation to restrictions of behaviors consid- 
ered to be detrimental to their own health and 
to the health of others. Their relationships 


| Table 2 i 
: ji i italizati 
a Comparison of Irregular and Regular Discharge Groups on Attitudinal Adaptation to Hospitalization 
| : (N = 58) 
nn 
ie Regular Irregular 
a ——— * 
Se ae 
Scale rea SD Mean SD : 5 
O À titud Sass 
Ware? toward 32 96 <.30 
| nab regulations 60.51 9.79 58.16 a = Er 
rr Sonnet 86.19 15.68 86.88 1.34 <.10 
h bet Patients 21.87 2.93 20.53 ove 93 <.30 
Spital facilities 69.00 9.36 66.42 10. 
* $ š irectionality. 
D valı 5 ting reverse direc 
i Alues are for one-tailed tests. No p value was ascertained for means ee 
Table 3 Seyret 
4 ton ti Hospitalization 
| Comparison of Irregular and Regular Discharge Groups 0” Behavioral Adaptation to 
ej ar 
f Tezis Irregular 
Above Below at pt 
A Sı eaan ns Median Median Xe 
` oa cale z 
| on teoncemning: 16 6 13 aos pol 
i . i 
i "eBulations a Protect patients’ health A 18 3 a 4.54 <.01 
r ersonnel Protect others’ health 2 17 2 13 1.99 < 1 
ho CT patici 20 19 14 2.57 z 
B nts a 20 ? 12 10 <.30 


* 
Medi 
tp Cdian i e jance. 
2 values St E tilized because of heterogeneity of variance 
€ for one-tailed tests. 


ent 
© outside hospital 19 
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Table 4 


Comparison of Irregular and Regular Discharge Groups on the Adaptiveness of 


Situations External to the Hospital 
Regular Irregular 
Above Below Above Below i pt 
Scale Median Median Median Median Xe" 

Adaptation concerning: i z <10 
patients’ employability 18 21 5 14 i 10 
Pressure from others to continue 1.92 <. 

treatment 16 12 4 8 24 a 
current economic status 14 14 6 6 = a 
other family responsibilities 14 14 6 6 i 

ald 
¢ Median test utilized because of heterogeneity of var a i jian was è 
tp ee ‘for one ee Nee cA pay for scales where frequency above and below the medi 
for both groups. PF 
jor W 
A pai italization is past behav’ | 
with ward personnel were also significantly response to hospitalization Is pa ecific situ 

Jess adaptive. a variety of situations, pea oe of hos- 

Š n j A . i 
The third hypothesis stated: The type of tional differences in the ro beat rolé mary 
situations external to the hospital are less pitalization playing a less imp 


conducive to continued hospital treatment for 
the irregular than for the regular discharge 
patients. Reference to Table 4 indicates that 
this hypothesis was not supported in any of 
the four selected classes of situations, 


Discussion 


In an earlier study, the Present authors 
were critical of the “personality determinism” 
type of approach typically used in experimen- 
tal studies of the irregular discharge prob- 
lem. At that time we argued, “It seems 
equally reasonable to assume that other fac- 
tors, entirely independent of Personality, may 
be just as important correlates of such þe- 
havior as the personality that the patient 
‘brings with him’ into his particular hospital 
environment” (2, p. 66). 

Insofar as extra-personality determinants 
were measured in the present study, however, 
they did not serve to differentiate the irregu- 
lar and regular discharge groups. The results 
of tae present study would suggest instead 
that the best predictor (or determinant) of 


Differences between the regular adjustme! 
lar discharge groups in past life rele 
are striking. In grade school the se trua! 
charge group was significantly ™ teache™ 
had more difficulty with peers es si fewe! j 
In adolescence they had fewer ae church : 
Social interests, and quit attend! more f° 
earlier. In the military, they oe dislike 
quently disciplined, they more e failed 
officers and they more ecu change 
gain in rank. Occupationally, t vee’ rel 
jobs more frequently because they eld ™ 
of the job” or were dismissed; they 


a 


id, an e 
menial jobs, were less sell pait, m of a 
more frequently unemployed. In e 


prehospital behavior areas measur rection 8 
of the irregular group is in m of the are 
maladjustment, and in over hal 
significantly so. 

This maladjustive pattern, as 
the gross examination of past of 
magnified by direct observation wor 
in the hospital. Here the Oe fur pst 
group, as independently rated by Be agai 
ers long before voluntary disc an of £ 
medical advice, was in the direc asite T 
adjustment on every variable we vior i ad 
maladaptive nature of their po A jsreg 
hospital was most evident in t 5 eir 9 
of regulations designed to protec 


Determinants of Treatment of Tuberculosis 


Malih and the health of others, and in their 

pie with hospital personnel. 
tor further point about the nature of the 
ee problem should be men- 
ene small group of individuals, prob- 
People Sones than 10 or 15 per cent of all 
A he pi for tuberculosis, appear to 
lem. Tiie the entire irregular discharge prob- 
regular FY small group, through repeated ir- 
nual “iy ischarges, builds up the reported an- 
per eu discharge rate” to almost 50 
in the | For example, the nineteen patients 
tributed present sample have already con- 
charges TE average of four irregular dis- 
maladjust hus, a relatively small group of 
Source f ed individuals seem to provide the 
what — the technically accurate but some- 
of all A eading statement that almost half 

e he sPitalized tuberculous patients leave 

Ospital against medical advice. 


Summary 


the tis study examined some relationships of 
ation aas patient’s (a) family of ori- 
Vetbalined > prehospital life adjustment, (c) 
Ospital attitudes toward situations mM the 
(e) curr (d) behaviors in the hospital, and 
S suce ent outside-the-hospital situations, to 

the ho ess or lack of success in remaining in 
leteq core until his treatment was com- 
Was coll nformation in the above five areas 
Patients ected on 140 currently hospitalized 
tion, 19° Within nine months after examina- 
ainst Patients voluntarily left the hospital 
Ospita, eel advice and 39 completed their 
Oup: treatment. Comparison of these two 
S disclosed no differences in family of 


Orien í 
tation, verbalized attitudes toward the 
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hospital, or in current outside-the-hospital 
situations. Significant differences between the 
groups appeared, however, in prehospital life 
adjustment and in behavior within the hos- 
pital. It was concluded that hospitalization is 
but the most recent of a long series of life 
situations in which the irregular discharge 
patient has demonstrated his inability to 
make an adequate adjustment. 
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The Use of The W-B Picture Arrangement Subtest 
as a Projective Technique"? 


Boris Breiger 
Chicago State Hospital 


The W-B Picture Arrangements (PA) was 
used as a projective technique in a cross-cul- 
tural study (1) comprising 30 U. S. Cauca- 
sians, 20 Nisei, and 10 German refugees. All 
Ss were male, except two refugees. Variables 
controlled were Full-scale IQ, college status, 
age, urban-rural residence, and bilingualism. 
After completing the entire W-B, the “Flirt” 
and “Taxi” sequences were re-presented ac- 
cording to the Ss’ original arrangements. Ss 
were asked to entitle the episodes and tell the 
Story, card by card. A TAT-type inquiry fol- 
lowed. 

Although no Significant group differences 
were found on PA weighted scores or on raw 
Scores of all sequences, a content analysis of 
“Flirt” and “Taxi” revealed marked differ- 
ences. Categorization of “Flirt” and “Taxi” 
into projected motivational factors reveal chi- 
Square values significant at the 01 and .05 
levels respectively. Eighty per cent of the 
Caucasians projected a flippant story on 
“Flirt,” entitling it “Pick up,” while 65 per 
cent of the Nisei denied any romantic impli- 
cation and entitled it “Chivalry.” Nisei per- 
ceive the person in “Taxi” as being anxious 
in response to a member of his family “ob- 


1 Presented at the 1953 meeting of the Midwestern 
Psychological Association, Chicago, Ill. 

2 An extended report of this study may be ob- 
tained without charge from Boris Breiger, Chicago 
State Hospital, Chicago 34, Ill, or for a fee from 
the American Documentation Institute. To obtain it 
from the latter source, order Document No. 4749 
from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.25 for micro- 
film or $1.25 for Photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. ` 


ze no 
serving” him, while most Caucasians i F, 
reference to any specific external eS than 
anxiety. Significantly more ee 
Nisei (.01 level) projected abnorma followe 
havior into “Taxi.” Refugee stories 
U. S. Caucasian patterns. . wt hos- 
Subsequent use of this technique a o 
pitalized patients aided in the ora elea 
well-defended persons who appen testing: 
tually intact upon standard we naties A 
Such persons frequently project on - 
pressing sex role confusion, prosti 
tasies, and paranoid ideation. — i 
The present work suggests tha Jely upo? 
pretation of the PA test based sging. T 
weighted scoring may be mislea percep 


ter- 


having a common rationale (2) me ning of 
to overlooking the projective ~*~ these 1 
certain W-B stimuli. Awareness O h seckind 
plications offers a lead for gen ive 

to integrate psychometric and pro] 

data. 


Brief Report. 
Received November J, 1955, 
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Validity of the Marsh-Hilliard-Liechti MMPI 
Sexual Deviation Scale in a State 
Hospital Population 


Roland M. Peek and Lowell H. Storms 


Hastings, Minnesota, 


Ina 
Hilliard, and article in this Journal, Marsh, 
Scale ef 168 | Liechti (1) reported an MMPI 
Per cent i which served to pick up 88 
Paths at re two samples of sexual psycho- 
Positives rs expense of only 11 per cent false 
Check on mei UCLA students. However, 2 
nating sex e utility of the scale for discrimi- 
Otics mat from neurotics and psy- 
est ineffe ealed overlap so great as to sug- 
Perhaps 'ectiveness, and the authors say that 
10n or sae factor of personality integra- 
Scale” (4 justment is being measured by the 
their findi p. 58). This view is supported by 
dtained ngs that high scorers on the scale 
alues, aceon higher F and lower K 
Vestigate e study was designed to in- 
Ospital s e effectiveness of this scale in a 
: as by (a) evaluating jts power 
$ in Tal e sex offenders from nonofiend- 
Pulation samples from the same hospital 
Toups wit (6) comparing the scores of both 
Stoup, hay a nonhospitalized nonoffender 
MM Sars (c) comparing scores with other 
atiables to test further the hypothe- 


Sis th: 
at thi 
Br this scale is primarily 4 measure of 
The present 


S 
e Sow i 
, Personality integration. 
that of com- 


situati $ 
ting c is less artificial than 
erua ae students with already referred 
Mental re opatiis, since the present experi- 
a ae more closely approximates the 
malty a ea situation and types of subjects 
ch the scale would be utilized. 


Procedure 


The 
A ava a h-Hilliard-Liechti scale was scored 
Tih: (a) e MMPI’s for three group: of sub- 
a group of 13, sex offenders com 


State Hospital 


prising all those testable male pati i 
Hastings (Minn.) State Hospital ine ee 
mitments were primarily for severe sexual mis- 
behavior (four molesters, two rapists, two un 
controlled homosexuals, three exhibitionists, z 
fetishist, and a voyeur). Their mean age oe 
39.7 with a range of 16 to 62. Nine carried 
diagnoses of some form of psychosis, while 
four were personality or character disorders. 
Nine were single. (b) Thirty unselected male 
patients representing all those taking the 
MMPI consecutively during the period of the 
study and whose ages fell between 16 and 60 
excluding the sex offenders, of course. Ages 
ranged from 19 to 52 with a mean of 36.8. 
In this group were 22 psychotics, three neu- 
rotics, and five personality and character dis- 
f the 30 were single, a signifi- 
proportion than in the above 
group (p< 05). (c) Thirty male psychiatric 
k the MMPI as part of a rou- 
tine battery inistered soon. after employ- 
ment. Ages ranged from 
of 31.3. Sixteen of the 29 whose m 
was known were single. 
rlap comparisons be- 


Mean score and ove 
croup of sex offenders and the 


tween the § oe. 
c aide groups were 


patient and psychiatri s 
ns with the 
(1). In the 


obtained, as well as compariso 
original standardization groups 
patient group, correlations were computed þe- 
tween the sexual deviation scale and each 
other MMPI scale. 

Results 


on the sexual deviation scale 


Mean scores 
= 7.88) for the sex offenders, 


were 43.31 (SD 
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Table 1 


0 7 3 iati cale, 
Discrimination of Sex Offender, State Hospital, and “Normal” Groups on the Sexual Deviation Scale, 


Using Original and Modified Cutting Scores 
(Entries are percentages) 


Sex offenders 
pe 


Unselected 


© 
Hastings State — oc al 
State Hospital Psychiatric MILL (1) 
Cutting M-H-L (1) Hospital patients aides (N =317) 
score (N=338) (N=13) (V=30) (V=30) ? 
11 
>30 88 85 87 43 30 
<30 12 15 13 37 100 
Total 100 100 100 100 
1 
>42 41* 77 33 7 99 
<42 59* 23 67 93 100 
Total 100 100 100 100 
* Interpolated from Marsh et al., Table 2 (1). 
t significant 
38.77 (SD = 6.65) for the patients, and 29.70 42. All other comparisons were not sig 


(SD = 8.61) for the psychiatric aides. 

Table 1 presents percentages of the Marsh 
et al. samples and the Present groups falling 
above and below the original cutting score of 
30 and the cutting score of 42 found to dis- 
criminate optimally between hospitalized sex 
offenders and other patients, The original cut- 
ting score, reported as Picking up 88 per cent 
of California sexual psychopaths, similarly 
discriminates 85 per cent of hospitalized sex 
offenders in the present study. While this dis- 
crimination is attained at the expense of mis- 
classifying only 11 per cent of the college stu- 
dents, 87 per cent of our patients (almost 
complete overlap) and almost half of the psy- 
chiatric aides are misclassified as sex devi- 
ates. The higher cutting score of 42 reduces 
the false positives among patients to 33 per 
cent and the false positives amı 
students and psychiatric aides to 1 per cent 
and 7 per cent respectively. However, this 
score, which achieves maximal differentiation 
in the hospital population, correctly identify- 
ing 77 per cent of the hospitalized sex offend- 
ers, selects only 41 per cent of the original 
group of sexual psychopaths. 

Using the chi-square test, differentiations 
were significant at the 1% level between both 
sex offender groups and both “normal” groups. 
The discrimination between our sex offenders 
and patients was also significant at the 1% 
level, but only using the new cutting score of 


ons 
including three of the four comparis® 
sex offenders with patients. ion scale 
Correlations of the sexual deviati n- 
with MMPI scales computed for He able 2. 
selected patients are presented in rates 8° 
It can be seen that this scale ca gas 
nificantly with a number of MMP the validity 
strongest relationships being with an other 
scales F and K (about .60, p< 3 to -53 ? 
reasonably high correlations (.5 d Sc- The 
< .01) were found with Mf, Ma, an 


Table 2 


Correlations of Sexual Deviation Scal tients 


MMPI Scales in 30 State Hospital Pa 
e 


Correlation of corre- 
with Sexual Jation 
ong college MMPI Deviation q test 
Scale Scale 
ns 
L —.30 001 
F .60 001 
K —.59 05 
Hs 37 ns 
D Zi ns 
Hy .23 05 
Pd A2 OL 
Mf 53 ns 
Pa .28 05 
Pi 39 ‘ol 
Sc .50 01 
Ma 52 ië 


e 


— 


——_- 


e 


Validity of the MMPI Sexual Deviation Scale 


lower correlations with Pd, Pt, and Hs were 
Significant at the 5% level. 


Discussion 


Pe A confirm the incidental findings 
scale oe a al. that their “sexual deviation” 
iie, not discriminate sex offenders from 
upon a ae psychotics, throwing more doubt 
cated i main conclusions than they indi- 
almost e mean score of our patients was 
fender as high as the means of the sex of- 
Ported groups and considerably above the re- 
mal” cutting point; the mean of our “nor- 
the ae of psychiatric aides was almost at 
ing peat point they recommend. This cut- 
Sex deen fails completely to discriminate 
Patients ers from unselected state hospital 
Psychiatric nd even classifies two-fifths of the 
enders 4 aides with the committed sex of- 
Btoups , he optimal cutting point for our 

er ls better discrimination but the 
ing e — unsatisfactorily large. Apply- 
(2), th ase-rate analysis of Meehl and Rosen 
ive ion use of this scale to increase predic- 
suming becomes still more questionable. 
Of sex of a liberal 90 per cent discrimination 
Positives enders as against 11 per cent false 

em, wi in a group to be delineated from 
of Slee a base rate of 2 per cent for sex 
; ti in a given population (our rate is 
Tolls at Es of the patients on the hospital 
© Perso e present time), 86 per cent 0 
Scale vill classified as sex deviates by the 
Offenders, ° false positives, actually not Sex 


rela tgh computed on a small N, the cor- 
that ihe consistent with the hypothesis 
of Der e sexual deviation” scale is a measure 
norm ality disintegration and general ab- 


A mae The fact that the validity scales 
“sexual K correlate most strongly with the 
Negat: deviation” scale and in positive and 
hig lee directions respectively shows that 
a Sc on the sexual devia 
Brea ean in this abnormal grou 
Ness, -p)tsorganization and lower 
that item is interesting in view of 

Mupr™ overlaps between this scale and 
three ;, Scales are very low (for example, 
With ems overlap with F; seven overlap 
» but three of these are scored in the 


9p; = 
Posite direction). 
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Having confirmed the suspicion of Marsh 
et al. that their scale might be a measure of 
gross adjustment, our results indicate further 
that it is not a measure of sexual deviation in 
any broad application. A measure which dif- 
ferentiates a special group from another group 
may measure not only what the members 
of the special group have in common, ¢-§., 
sexual deviation, but may measure what that 
group has in common with any number of 
other groups, in this case general abnormal- 
ity. It would be absurd, for instance, to call 
the Miller Analogies Test a Theoretical Physi- 
cist Scale because it discriminates theoretical 
physicists from high school graduates. 


Summary 


This study was performed to ascertain the 
validity of the Marsh, Hilliard, and Liechti 
Sexual Deviation Scale for the MMPI in 
groups of considerably different composition 
from their standardization samples and to 
check their incidental suggestion that the scale 
might be a measure of general personality 
integration. 

Groups of 13 sex offenders, 30 psychiatric 

atients, and 30 psychiatric aides with avail- 
able MMPI’s were scored on the Sexual 
Deviation Scale, and correlations between 
he other MMPI scales were 


that scale and t [ i 
obtained for the group of patients. Compari- 


sons were made among the present groups and 
between them and the original standardization 


i uthors’ cutting score 
groups using the above a g 


as well as another which was found optimal 


the present study. ei 
o ie following were obtained: 
1, Neither cuttin; rentiated ef- 


fectively between patients and sex 


in fact, just as high a percentage o 
as of either grou. 
the cutting score rec 
et al. ; 

igi score fa 

2. The original cutting 

criminate psychiatric aides from sex offenders 
ay, although the new cutting score 


iled to dis- 


i more successful. i 
was 3 A f the scale with other 


Jations © r 
a ois pport the hypothesis that the 


MMPI scales SU. i i 
Y e measures gross maladjustment or lack 
P ion. The strongest re- 


integration 
lationships are with the validity scales F and 
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K, and are positive and negative, respectively. 
High scorers on the “sexual deviation” scale 
tend to be more unstable, uncontrolled, con- 
fused, and prone to reality distortion. 

It was concluded that the scale has little 
utility for the purpose for which it was de- 
signed and would fail to select sex offenders 
from many populations, since most people 
with high scores would have other than sexual 
problems. This scale seems to function more 
as a measure of general abnormality than of 
deviant sexual trends. 


The inefficiency of such a scale in predict- 


2. Meehl, P. E., & Rosen, A. Antecedent 


Roland M. Peek and Lowell H. Storms 


Š š n " . any 
ing behavior which is so rare in ali ie 
population as are sex offenses was also 
cussed. 


Received July 25, 1953. 
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Cognitive, Affective, and Psychopathological 
Correlates of the Taylor Manifest 
Anxiety Scale 


Aron W. Siegman 


Veterans Administration Hospital, Bronx, N 


ew York} and Teachers College, 


Columbia University 


Th 
(MAS) ran ‘Taylor Manifest Anxiety Scale 
Manifest a ) is widely used as a measure of 
torily ite it has never been satisfac- 
ave yie] aa Some attempts at validation 
ave yielded positive results (4, 9), but others 
ndings M equivocal (10) or negative (2) 
8ests that oreover, recent research (11) sus- 
dicate 1 a low score may not necessarily in- 
’s rel ack of manifest anxiety, but rather 
n ge to admit it. 
ts a sitive side are the many experi- 
sumption confirm predictions made on the 
anifest ; that the scale is a measure of 
Petiment, anxiety. In some (16) of these ex- 
anxiety S it was found that much manifest 
enhance as indicated by a high Taylor scores 
tasks i the performance on simple learning 
tasks Ut interferes with complex learning 
Obtained pee experimenters (7, 11) who 
Scores a correlations between Taylor 
i © questi scores on intelligence tests raised 
Ormance on whether differences found in per- 
high and on learning tasks as & function of 
be im low Taylor scores might not really 
2 most ction of differences in intelligence. 
Mtellige of these experiments, however, the 
nce test consisted of & limited num- 


be 
To 
t 7 
ip asks. Moreover, some of the tasks were 
rom 
Neuropsyenie Clinical Psychology Section of the 
A Sh H jatric Service at the Veterans Adminis- 
op tess his eee Bronx, N. Y. The author wishes to 
Ch, euro appreciation to Drs. H. L. Flowers; Chief 
a Rey and R. S. Morrow, Chie! 
> ae for their sustained inter 
to Dr. Julia C. Hall, Assistant 


Sychologist in charge of researc’ for her 
e of this re- 


Men 


Enego; 
Se; agemi 
arch, ent and help at every stagi 
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actually learning tasks, and others had time 
limitations. In both cases a negative correla- 
tion is to be expected (16, 13, 19). In the 
present experiment Taylor scores were cor- 
related with scores on the Wechsler Adult In- 
Scale which includes a wide variety 
e tasks, timed as well as untimed, 
learning tasks. 


telligence 
of cognitiv 
and only a few 


Procedure 


Several validation procedures were at- 
tempted. In the first, the Taylor MAS scores 
of 90 patients were correlated with their 
scores On & manifest anxiety rating scale 
(MARS). In the MARS, each patient was as- 
signed by his psychiatrist or psychologist a 
score of 1, 2, OY 3, corresponding to low, 
medium, and high, on nine criteria of mani- 
fest anxiety. These criteria are essentially the 
same as those described by Buss et al. (4). 
‘All the patients were in contact, and of at 
least normal intelligence. None was suspected 
of having cortical damage. In a further at- 
tempt to validate the Taylor MAS, the Taylor 
scores of patients who received a diagnosis of 
anxiety neurosis were compared with the Tay- 
Jor scores of patients with other neurotic diag- 
noses but who were free from symptomatology 
of manifest anxiety. The Taylor scores of pa- 
tients with other psychiatric diagnoses, pat- 
the psychopathic personalities, who 
d to have very little manifest 
were also of interest. In each 
diagnosis was agreed upon by the 
psychiatrist and consulting psy- 


patient’s A 
d all diagnostic “problem cases” 


chologist, am 


” 
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were excluded. In yet another but more in- 
direct attempt at validating the scale, the 
Taylor scores of all 90 patients were corre- 
lated with their scores on a self-esteem scale 
(20). Since a variety of dynamically oriented 
theorists (14, pp. 182, 191) maintain that 
anxiety is a function of threat to one’s self- 
esteem, a negative correlation between the 
two scales was anticipated. 

To investigate the hypothesis that reluc- 
tance to reveal one’s anxiety symptoms to 
others is a significant source of variance in 
performance on the Taylor MAS, the scale 
was administered under two different condi- 
tions. One group of 23 psychiatric but non- 
psychotic patients took the test as part of a 
diagnostic testing procedure, which they know 
has serious consequences. Another similar 
group of 33 patients took the scale in a 
group. They were told that since E was solely 
interested in the efficacy of the scale, and 
how people respond when they are free to 
be frank, they were not to indicate their 
names. Both groups were equated for age, IQ, 
and diagnosis. If reluctance to reveal one’s 
anxiety symptoms depresses one’s Taylor 
score, then the first group should obtain sig- 
nificantly lower scores than the second group. 

Finally, in order to investigate the relation- 
ship of Taylor MAS scores with IQ, the Tay- 
lor scores of 35 medical and psychiatric pa- 
tients, in whom brain damage and psychosis 
were definitely ruled out, were correlated with 
their WAIS IQ score. Their Taylor scores 
were also studied in relation to their scores on 
each of the eleven subtests, unadjusted as well 
as adjusted for IQ. Adjustment for IQ was 


Aron W. 


Siegman 


Table 1 


Mean Taylor MAS Scores in Relation 
to Psychopathology 


Mean 


14 35.00 
18 22.89 
17 22.53 
15 26.27 529 
10 13.83 


Psychopathology N 


Anxiety reaction 

Other neuroses 

Latent schizophrenia 
Paranoid schizophrenia 
Psychopathic personality 


n 
e Be ai core 0 
achieved by subtracting S’s weighted $ 


i i weig' 
a particular subtest from his mean 
score on the remaining subtests. 


Results 


: > scores 
The correlation between the patients S 
on the MARS and their Taylor = peyon 
r = .34, which for 89 df is significan 
the .01 confidence level. jents 
Table 1 indicates that of the 90 j 
14 received a diagnosis of anxiety includ- 
18 received other neurotic dingo mani- 
ing character neurosis, but were pe schizo 
fest anxiety symptomatology, ie J 
phrenics, 17 were latent schizoph! f opathi¢ 
and 10 received a diagnosis of Pre othe 
personality, which does not inclu ajining 1 
character disorders (1). Of the ee not fre 
patients, 5 had diagnoses which pe neuro, 
quent enough to be grouped, 6 action be 
diagnoses other than anxiety Te a wer 
with manifest anxiety symptoms, 3 indicate? 
diagnostic “problem cases.” Table siet¥ 
that the patients with a diagnosis 


f an tha 
h ores 
reaction had significantly higher 5C 


Table 2 


t Values of the Differences Between Mean Taylor MAS Scores of the Various 
Psychopathological Groups 


Psychopathological groups 


Anxiety reaction vs. other neuroses 

Anxiety reaction vs. latent schizophrenia 
Anxiety reaction vs. paranoid schizophrenia 
Psychopathic personality vs. anxiety reaction 
Psychopathic personality vs. other neuroses 


Psychopathic personality vs. latent schizophrenia 
Psychopathic personality vs. paranoid schizophrenia 


Paranoid schizophrenia vs. latent schizophrenia 
Paranoid schizophrenia vs. other neuroses 


: a i 
3.24 30 Soi 
3.21 29 <.05 
2.37 27 201 
6.97 22 <.05 
2.24 26 2.05 
2.07 25 Zol 
3.19 23 

88 30 


| 


A 


C p 
orrelates of the Taylor Manifest Anxiety Scale 


Table 3 


Mean Tay 
oe MAS Scores in Relation to Test 
ification and Test Anonymity 


Grou 
Test i p N Mem sD é 
Test identification 23 27.30 3 
onymity 33 31.64 Be 1.82 


any othe 
iagnosis Gf oes’ and that the patients with a 
nificantly Io psychopathic personality had sig- 
è ae scores than any other group. 
cores aT between the patients’ Tay- 
=~ 72. which their self-esteem scores was 
Table 3 hich for 89 df is highly significant. 
aylor a eales that Ss who took the 
imele are ae did not identify 
igher scor ailed to obtain significantly 
fe, of a T than Ss who took the scale as 
nding bi testing procedure. This 
admit one’ ngly suggests that reluctance to 
nificant i S anxiety symptoms is not a sig- 
; lita eae 
o ewer was no significant correla- 
Pu Scores (+ Taylor MAS scores and WAIS 
etas etmore J — .19, epsilon-square = .16). 
W N between th of the correlations (7's and 
ite subtest e Taylor MAS and any single 
oe ed for IQ, 4 adjusted as well as unad- 
o , was significantly different from 


lor g 
i 


Discussion 


A hou 1 
S ps three validating procedures 
ig the T ve results, the correlation be- 
int direct 'aylor MAS and the MARS, the 
PES stud riterion of manifest anxiety used 
haa Stent with | cather low. This finding is 
a dieu previous research which has 
of raged in obtaining significant cor- 
»°Ssful in aylor MAS, but was much less 
Ma of ore the scale with direct 
ict toe anxiety. In terms of a 
Vali ndings by Cronbach and Meehl (5), 
tion, ton of suggest that though criterion 
Sid able res the Taylor MAS yields ques" 
able ults, it does appear to have con- 
com te uel validity. 
Ma pation M be several reasons for 
R etween the Taylor MAS 


n s 
e possible explanation is 


the low 
and the 
that the 
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Taylor score repres 
i presents the S’s ev i 
hoes oem, oe s evaluation of 
roy it is conceivable that 
wo Ss who are rated alike i i 
: e in manifest anx- 
iety, one will be more s iti i 
cae sensitive to his own 
psychological experiences and symptoms than 
the other. This hypothesis i 
the following facts: eee ge ch 
“aig F 5: (a) preyious investigators 
ported higher correlations between 
the Taylor MAS and the Ss’ reports of thei 
own manifest anxiety symptoms than ie 
tween the Taylor MAS and the same but ie 
jectively observed symptoms (4), (b) the 
average MMPI profile of high Taylor scorers 
suggests that they are “introspective quite 
sensitive to environmental press, and ‘villing 
to admit to being easily disturbed. The low 
scorers, conversely, utilize both denial and 
repression fairly frequently and rarely intro- 
spect” (3, P- 435), and (c) several investi- 
gators (3, 6) have reported significant cor- 
relations between the Taylor MAS and the 
Pt scale of the MMPI, whose items refer to 
“unreasonable fears as well as overreaction 
to more reasonable stimuli” (8, p. 20). An- 
other possible explanation for the low cor- 
relation between the Taylor scale and the 
MARS is that the Taylor scale is loaded with 
chronic somatic manifestations of anxiety 
stomach troubles, etc.) and thus 
in the direction of a particular 
manifestation of anxiety. In order to test this 
hypothesis, the Taylor MAS was submitted 
to five experienced clinical psychologists who 
were asked to indicate which items reflected 
chronic somatic manifestations of anxiety and 
‘which reflected primarily psychic manifesta- 
tions of anxiety. A chi-square test was then 
ine which items of the Taylor 
level or better 


MAS differentiated at the .10 
in the uppe! third 


lower third of 


es distribution. Whereas 12 
ing to chronic 
only 1 such 
between the 


and those Ss 
the MARS scor 


findings tend to support 
the many items referring 
symptoms are an undesired source of variance. 


The absence of significant correlations be- 
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Table 4 


Taylor MAS Items Which Differentiated at the .10 
Confidence Level or Better Between a Group 
Which was Rated High and a Group 
Which was Rated Low in 
Manifest Anxiety 


Confidence 
Item level 
1. I am no more nervous than most others. 10 
2. I work under a great deal of strain. OL 
3. I worry over money and business, 02 
4. I frequently notice my hand shakes when 


I try to do something. 02 
5. I worry quite a bit over possible troubles. 01 
6. Iam often afraid that Iam goingtoblush. 01 
7. I have nightmares every few nights. -10 
8. At times I lose sleep over worry. -01 
9. I often dream about things I don’t like to 
tell other people. -10 
10. Ihave a great deal of stomach trouble. -10 
11. Lam easily embarrassed, 02 
12. I feel anxious about something or someone 
almost all of the time. 001 
13. Lam happy most of the time. 05 
14. It makes me nervous to have to wait. -10 
15. At times I have worried beyond reason 
about something that really did not 
matter. 05 
16. I have been afraid of things or people 
that I know could not hurt me. 05 
17. Sometimes I become so excited that I 
find it hard to get to sleep. 10 
18. Lam the kind of person who takes things 
hard. -10 
19. I am a very nervous person. -001 
20. Life is often a strain for me. -01 
21. Lam not at all confident of myself. .10 
22. I am very confident of myself. -10 


Siegman 


evidence (12, 17) for this clinical ind X 
the finding is a challenge to the vali i Í 
the scale. However, two possible explana? | 
may be offered. One is that the Taylor 
is a measure of S’s general level of a is 
anxiety, but in no way indicates how tins | 
sponded to a particular a laa sel- 
task. Secondly, in clinical experience and i 
dom if ever relies on only one subtesh a A 
is conceivable that the Taylor score b a 
lated to performance on a comba i 
anxiety-sensitive subtests. In caer 
this hypothesis the subtests were ei 
anxiety tests, which ee) cag ef 
span, digit symbol, block design, rs tests | 
race ( 13, 12, 17) and nonansie'y oh 
which include information, comp comp 
similarities, vocabulary, and pictur 

tion. ich 0 
Table 5 indicates that the group WP igh f 
tained high Taylor scores (36 e an 
which represents the 75th DE ne o 
above) also obtained significantly si whi 
on the anxiety tests than the gr and 1es | 
obtained low Taylor scores (1 i nde Be 4 


ifest | 


b- 


which represents the 25th percent i g of 
low). This finding is consister: sing su 
clinical practice not to rely oD 
test. 
Summary fe was 
A validational study of the Tay r 
found that: 2r 


related ” whi? 


cor 
1. Taylor MAS scores sca e 1 co" 


. ing 
with a manifest anxiety rating 


e ê 
tween the Taylor MAS and any one of the for 89 df is significant bey ond h tha! m 
eleven subtests of the WAIS raises an inter- fidence level. It was hypothesi r that re 
esting problem, since many of these subtests low correlation is due to the item, ty. 
are considered in clinical practice (15) as re- Taylor MAS contains too aay ie 
liable indices of manifest anxiety. In light of ferring to chronic manifestations was 
the fact that there is substantial experimental This hypothesis was supported 
Table 5 4 
Mean Scores on Anxiety and Nonanxiety Subtests in Relation to Taylor MAS Scores l 
Mean Mean 7 
anxiety nonanxiety if 
Group N tests SD tests SD 7.86" 
High Taylor scorers 10 10.00 1.50 11.60 2.20 1.33 
Low Taylor scorers 10 10.75 1.98 11.77 2.38 


* Significant at the .02 confidence level. 
t Fisher's ¢ for correlated means. 


Correlates of the Taylor Manifest Anxiety Scale ial 


analysi 5 es P à 
ysis of the scale. Individual differences 1m 6. Eriksen, C. W., & Davids, A. The meaning and 
clinical validity of the Taylor anxiety scale 


self- itivi enia scal 

eee and sensitivity to one’s symp- 

of the s to be another source of variance - MMPL Vanes Se: vals 1955, S0 
ms fs he ate . abnorm. soc. Psychol, 1955, 50, 


2. Pati . 

. Pa 4 , 5 S > 

tients with a diagnosis of anxiety Te- _ Grice, G. R. Discrimination reaction time as a 
function of anxiety and intelligence. J. ab- 


action Chee 
ies re significantly higher Taylor MAS 
an all other diagnostic groups, 3 H Jee S ane eb om 
- , S. R, y, J. C. Minnesota 


~ 


whereas pati is 5 $ 
Pathic D with a diagnosis of psycho- Multiphasic Personality Inventory. New York: 
scores tha ity had significantly lower Psychological Corporation, 1943. 

3. T n all other diagnostic groups. 9, Hoyt, D. P., & Magoon, T. M. A validation study 
des aylor MAS scores correlated — 72 with of the Taylor Manifest Anxiety Scale. J. clin. 
scores on a self-estee’ le which for 59 dj Psychol, 1954, 10, 357-361. 
is significant b m scale which tor 10. Kendall, E. The validity of Taylors Manifest 

FES suc eyond the .01 confidence level. Anxiety Scale. J. consult. Psychol., 1954, 18, 
consider ggested that the Taylor MAS has 429-432. 
titers able more construct validity than 1- Kerrick, Y. S- Some correlates of the Taylor 

ion validity. Manifest Anxiety Scale. J. abnorm. soc. Psy- 
chol, 1955, 50, 75-77. 


Patie: . R P 
lor MAS nts who did not identify their Tay- 12. Mandler, G., & Sarason, S. B. A study of anxiety 
n records did not obtain significantly and learning. J. abnorm. soc. Psychol, 1952, 


Igher A 
Jer scores than patients who did identify 47, 166-173. 


13. Matarazzo, J. D., Ulett, G. A. Guze, S. B. & 


eir rec 
ords. 
- Tho PEE Saslow, G. The relationship between anxiety 
lati ugh there was no significant corre- level and several measures of intelligence. J. 
VAIS consult. Psychol, 1954, 18, 201-208. 


on 

E tweeti Taylor MAS scores and WA i 

i nis high Taylor scorers did obtain sig- 14. May, R Ti — 

i y low ety-sensi- Ronald Press, 1950. 
wer scores on the anxiety-sens! sonus man, Mili s 1959. R, & Rapaport ie 


g of anxiety. New York: 


tive 

Subt : Si 15 

Subtests ests than on the nonanxiety-sensitive terpretation of the Wechsler-Bellevue Intelli- 

for the | whereas no such difference Was noted gence Scale in personality appraisal. In H. H. 
‘Anderson & Gladys L. ‘Anderson (Eds.), An 


e low T 
aylor scorers. 
. ii introduction to projective techniques. New 


York: Prentice-Hall, 1951. 
A critical review of recent ex- 


yzner, M. S. : i 
salle i studies relating anxiety to learn- 
ewsltr y 1954, 5, 117-137. 
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Reliability of Case History Ratings and 
Intellectual Ability of Graduate Raters 


A. W. Bendig 


University of Pittsburgh 


Two studies have related educational level 
of raters to several measures of the reliability 
of ratings of clinical case histories (1, 2). 
Three rating measures were used: rater relj- 
ability, which is the average of the N(N — 
1)/2 intercorrelations among the W raters in 
the average 
of the N correlations of each single rater’s 
judgments with the pooled judgments of psy- 
chiatrists of the same clinical material; and 
of the vari- 
he mean rat- 


n rater and 
but again the under- 
Strated a significantly 


bias measures (d; p: 
129). 


These differences in 
sumed to be the result of the educational dif- 
ferences between the Ss, but whether less bias 
is due to greater training in Psychology, 
higher intellectual level, or increased interest 
in clinical work with patients among gradu- 
ate raters is unknown. 


Procedure 


Case histories. The rated stimuli were the 
10 abstracted clinical case histories used in 
a previous study ( 1). The cases varied in 
length from one to two pages of single-spaced 
typing and had been abstracted from com- 


clinic® 
plete case histories in clinic es ‘and 
subjects of the cases were all white rel ative’ 
varied in adjustment level a e A 
normal to hospitalized schizophre ag a bo% 
Stracted cases were mimeographe ter ji trut 
let with a face sheet containing "2 pace’ 
i i be used, aP% "sa 
tions, the rating scale to ale W i 
: x The sc ell 
for recording S’s judgments. nter and a 
seven-category scale with the ce e desc”! 
i d by t upod" 
categories verbally anchore ii” m at 
tive phrases “slightly gS ih 
ately maladjusted,” and “ex le ca Eroi | 
justed.” The intermediate a in previ 
were left unanchored as was dom! stu 
use of this scale (1, 2). o graduat? atl 
Subjects. The raters were he in grad at 
dents in psychology, ranging ear stl sot 
training from first- to fourth-y ir ma 
Of this group 25 had capres 
area of professional iniae remain e gs, 
counseling psychology, with the other 4 
having their major interest 1n social, pad | 
i.e., experimental, Sampara ry = 
chometrics, etc. Most of the Ss g 
taken the three-test graduate Jenson jes od 
battery described in detail by m the fi pis? y 
these scores were available fro The 45° 
the University Testing aren were 
tory booklets and rating scale te classes pse 
uted to the Ss in their gram gE 
the completed ratings collecte y 
uent class period. pad ize 
j Brien jarables The 27 Ss wigichoto al 
the graduate test battery were on four “tests 
on the basis of their raw ser Analogie gine 
lectual variables: the Miller s Ra Re 
a Mathematical Aptitude asure 4 pee 
Comprehension test, and a rable }4 
search Aptitude. This last va 


= 
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` 


‘elati 
. judg, 8 each S’s ratings with 


` Ability 


Reliability of Case History Ratings 
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Table 1 


eliabilit: Case History Ratings of Graduate Psychology Students Dichotomized on Six Rater Variables 
Ri y of . P Psychol i cf 
y 8: V 


Rater mera 
reliability R > sychiatric 
t ieh 
Rater variable a . : - ater bias reliability 
Mille: 3 : r t 
r Analogies High 13 g1 138 Pen = à l 
7 Low 14 86** re Lre 86** 0 
athemati ` 80% 
re me High 14 g2* 123 sat 78 5 
Low 13 86** 61** 7 ie 53 
Readin i “gst 
8 7 
com z High 14 aare 31 ott 
prehension Low 13 g5** i A 94 87** 30 
Resear , : .88** 
ch aptitude High 15 85** 62 59% 1.60 
å Low 12 82** 43 i oe 86 
Taduat, . ` 
e credits High 20 87** 1.69 73**  3.62** ea 
a Low 20 817 .49* 36** EL 
inical į $ 
l interest High 25 govt 85 63 01 w a 
Low 15 2" 63** ae 


te 
Signi: 
+e 28nificant at the .05 level. 


igni 
Bnificant at the .OL level. 


deve} 
lytic dot by Hyman (4) through factor ana- 
criteria 2 dures as a predictor of combined 
inear ¢ research ability and consisted of 
ading oN of subscales from the 
of 40 5 omprehension test. The total group 
Of the i also dichotomized on the basis 
M Psych, a number of graduate credits earned 
ology and on the basis of their €x- 


Dregs . 
€d clinical interest. 


Results 


were dichotomized separately on 
ree reli- 
pair of 
ter reli- 


Th 
each 5 Ss 
ability 
Stoups, 


k six rater variables and th 
— computed for each 
wo of these measures, "a 
analyses nd rater bias, were obtained by 
“ater ve variance of the ratings (1, 2). 
tion am lability is the average intercorrela- 
to the brs the raters in the ratings assigned 
OË the ener while rater bias is a measure 
Within ividual differences among th 
Underrate group to consistently overrate or 
Chiatrj all of the cases. The third measure, 

ing S Teliability, was obtained by cot 
Sment. 2 the pooled 
*Valuated of six psychiatrists who had also 
the 10 cases (1). The average Cot- 


e raters | 
one of these twelve € 


n of each group of Ss with the psychia- 
d by finding the mean of 
r-to-z) correlations within 


relatio 
trists was obtaine 
the transformed ( 


that group (3, PP- 133-134). 
The pairs of rater reliability and rater bias 


measures for each dichotomized group of 
raters were tested for significant differences 
by the procedure given by Edwards (3, p. 


136), using as the degrees of freedom for 
less than the 


the error 


ar procedures, 
ach averaged correla- 


tion the sum 0 
one S). The result 


be found in Table 1. : 
None of the dichotomized group differences 


in rater or psychiatric reliability was signifi- 
cant at the 05 level of confidence and only 
comparisons, that between 


d low in the number of earned 


Ss high an 
graduate credits, was significant at the 10 
level (£ = 1.69). Consequently it seems rea- 


conclude that intellectual and in- 


sonable to 
ese graduate Ss 


terest differences between th 
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had no effect upon their reliability in judging 
clinical case histories. However, two of the 
six comparisons on rater bias were significant 
at the .01 level. The Ss with high scores on 
the Miller Analogies test showed significantly 
more rater bias (¢= 2.77) and Ss having 
earned more graduate credits also showed 
more bias (¢ = 3.62). The significant differ- 
ences between Ss dichotomized on the basis 
of these two rater variables cannot be ex- 
plained by a relation between Miller Analogies 
test scores and number of graduate credits 
since the product-moment correlation between 
these two variables for 27 Ss was only — .05. 


Discussion 


Apparently intellectual, training, and inter- 
est differences among graduate students have 
no effect upon the reliability of their ratings 
of clinical case histories, but do affect meas- 
ures of rater bias. One S may rank order the 
10 cases about the same as another S, but the 
first rater spreads the cases along the low or 
adjusted end of the rating scale continuum 
while the second rater distributes the same 
case histories along the high or maladjusted 
portion of the scale. Raters with high Miller 
Analogies scores tended to vary more among 
themselves in the central tendency of their 
ratings than do Ss with low scores. Individual 
differences in the portion of the scale used 
for rating are also greater for more educa- 
tionally advanced graduate students. This 
greater rater bias is possibly a function of 
the divergent connotations of the global con- 
cepts of “adjustment” among more intellec- 
tually able and more academically experienced 
graduate Ss. For one rater the reported case 
behavior has to be quite deviant before he is 
willing to judge it as maladjusted, while the 
same behavior is judged much more strin- 
gently by another rater. Although these two 


. Bendig 


e edi 


rater variables, one intellectual and on just 


cational, are related to the absolute a 
ment level ratings given by graduate 3 
case histories, they are not related to 
relative ratings assigned by the raters. 


Summary 


Graduate students in psychology (N is for 
rated ten abstracted clinical case E i 
global adjustment level using a seve is 
rating scale. The raters were th pi 
mized on the basis of their scores 0n A wate 
school entrance tests, the Seager a 
graduate credits in psychology, © a Meas- 
pressed interest in clinical psycho EA com 
ures of rater reliability and bias "i roups 
puted for each of the dichotomies c 
and the measures of reliability m wa edu- 
pared by ¢ tests. None of the intel ee ated t0 
cational, or interest variables were e Millet 


rater reliability, but raters high on 


r 
; num! 
Analogies Test and with a age cantly 
earned graduate credits showe 5 
(.01 level) greater rater bias. j 
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Bod: š A 
y Cathexis as a Factor 1n Somatic Complaints*? 


Laverne C. Johnson 


Washington University S 


In rec 

Ourard ) work Secord (7) and Secord and 
tude toward have focused attention upon atti- 
able in an the body as an important vari- 
ality fom comprehensive theory of person- 
Conceive en They, like Murphy (6), 
or the mor the body as an anchorage point 
Y use of eo nai concept of the self and 
4 Td saye measures of body cathexis 
Significant a a (SC) have found a 
exis p ationship between the two. Body 

as the de as defined by Secord and Jourard 
Satisfaction s of feeling of satisfaction Or dis- 
esses of AA rE the various parts or proc- 
is paper o This definition will be used 

thi e relatior i addition to cross validation 
ines Paper: ( nship of body and self cathexis, 
a E the at presents information concern- 
E self, ad ity of attitude toward the body 
body catt (b) investigates the relationship 

tp even tho hexis to somatic complaints. 

Š Pa a Freud related hypochondriasis 
f cations a pints on of interest onto the 
tay Studies h functions of bodily organs; 
Lee, toward a been reported relating atti- 
Do ys e body to somatic complaints. 
RA ondriasi estigated body interest and hy- 
ca tested a in 20 children, but he was more 

T Uses of ë the types of body concern an 
xcessive body interest than he was 


n 
Com: = 
Soup Paring these 20 children to @ contro] 


Eve 


o 
€; 
e 
U 


Sec 
tec, ord 
ss hee Jourard (8) utilized a homonym 
sed of words having meanings per- 


O 


1 
Thi 
Bray US sty 
of th rom z was supported in part by 2 research 
Public Seer Institute of Mental Heal 
ae a calth pl ine of Health, United States 
rt rvice 
0 of $ 
of “Gaet Monte data was gathered un 
Scho Inical p; er 18(600)-927 with the D 
à sychology, United States Ait 


of iati 
Aviation Medicine. 


chool of Medicine and Research L i 
Malcolm Bliss Hospital PORTE 


taining to the body and also meanings not re- 
lated to the body to study this question. The 
subject responded with the first word that 
came to him after each oral presentation of 
the homonym. A significant relationship be- 
tween the number of responses having bodil 

meanings and BC was found. Tae cores 
Secord and Jourard believe, confirmed their 
hypothesis “that low BC is associated with 
anxiety in the form of undue autistic concern 
with pain, disease, OF bodily injury” (8, p- 
343). While these results indicate a relation- 
ship between BC and bodily concern when 
measured by @ word-association technique 

the findings do not answer the question 
whether BC will be related to the actual 


number of somatic symptoms experienced and 
reported. will dissatisfaction with and, pos- 
and body 


rn over body appearance 
the number of 


on a health ques- 
vestigated in the 


sibly, conce 
functioning be related to 


somatic symptoms reported 
tionnaire? The question is in 
present study. 

Subjects 


Fifty-two males and ninety-five females 
of 20.2 and 20.3 comprise the 


their electroen : 
f the subjects chosen 


of the EEG records 0 
classified as abnormal. The ninety- 


* would be 

five females were student nurses receiving 

their psychiatric training at Malcolm Bliss 
Hospital. 


3 Air Force Contract Number 18(600)-927; The 
Psychiatric Screening of Flying Personnel. 
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Procedures 


Each subject was administered the BC and 
SC scales and the Cornell Medical Index 
Health Questionnaire. The male subjects were 
administered the tests as part of the more 
extensive battery when they came to our hos- 
pital laboratories. 


The Tests 


The BC and SC scales were very similar to 
those used by Secord and Jourard (8). In- 
structions for the scales were changed to re- 
duce the tendency to response sets. The fol- 


lowing instructions appeared on the cover 
page: 


On the following pages are listed a number of 
things characteristic of yourself or related to you. 
You are asked to indicate which things you worry 
about and would like to change if it were possible, 


and which things you have no feelings about one 
way or the other. 


Consider each item listed below and encircle the 
number which best represents your feelings about 
yourself now according to the following scale: 7. 
Strongly dislike and wish change could somehow be 
made; 2. Don’t like, but can put up with; 3. Have 
no particular feelings one way or the other; 4. Defi- 
nitely like, am pleased with; 5. Consider myself par- 
ticularly and unusually fortunate. So that you will 
be able to judge each item carefully in terms of the 
above five statements, the scale will be at the top 
of each page. You may refer back to the scale as 
often as necessary to make your judgment of how 


you feel. Judge each item carefully. Do not use the 
same number for each item. 


The items and scoring procedure were es- 
sentially those used by Secord and Jourard. 
Organs pertaining to sexual functions were 
not excluded as was done by Secord and 
Jourard (8). 

These instructions were very successful in 
reducing response sets. The criteria used in 
the original study to measure response set 
were as follows: (a) a frequency > 32 in 
category 4; (b) a frequency > 28 in cate- 
gory 5; and (c) a frequency > 24 in cate- 
gory 5 accompanied by less than two re- 
sponses in categories 1 and 2 combined. 
Applying these criteria to the present sam- 
ple, only 12, 8 men and 4 women, of the 147 
subjects would be suspected of response sets. 
Whea compared to the 37 of the 126 subjects 
eliminated by Secord and Jourard, response 
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set does not seem to be a problem m this 
sample using these instructions. d 
The Cornell Medical Index Health Ta 
tionnaire consists of a series of ga 
which the subject is to answer yes OF ae 
the name implies, the items are ret 
with symptoms and diseases past a r a 
The particular form used in this 7 A 
used by the Air Force (1). With 1 in 
tion of containing fewer questions, identi 
contrast to 195, the test used here a ndes 
cal to the published Cornell Medis 
Health Questionnaire. Both men eo 
took the same form. The score on umber ° 
Questionnaire consisted of the i indicate 
symptoms or diseases reported a 
by the sum of the yes responses. 


Results acest 
The three scores obtained from ge score 
scales were: total BC, total SC aa 
called an “anxiety indicator a a total ° 
Jourard. The first two scores eid 
the ratings for each item on Po and r 
for each individual divided T i se 
spectively to get the average B sc scale in ie 
ing. A low score on the BC or low attitu! 
cates that the individual has 4 shes j 
toward his body or self and WIS sore "i 
could be made. A high BC OF : dividual y 
the other hand indicates the 1™ low ati 
pleased with his body or self. thexis ae 
then is indicative of negative ca is in icat! 
the body or self and a high ae indicat? 
of positive cathexis. The “anxie a 
score was obtained by summing, negat" sst 
for each male on the 13 T the J4” 
cathected items by the males an 
negatively cathected items a 
The sums were then divided by 
get an average rating. ales 


the | jes 
ected By givit 
sey 


sho 


re- 


Items most negatively cath 
were: strength, body build, ey 
weight, waist, energy level, widt oy nose: 
teeth, facial complexion, posture a z females g, j 
Negatively cathected items for ee. body ies ace? 
hair, facial complexion, nose, annie postures 
pearance, hips, legs, teeth, feet, identical 0 Po 
weight. These items are almost ii Š 
ported by Secord and Jourard, ei 
study the items most Topa AYA os ins 
concern over body appearance 


evy: 
functioning. Also, as reported by 


—_—-  — 


eS 
EE ama 


Body Cathexis as a Factor in Somatic Complaints 


primari i 
rily concerned with appearance while men in 


addition t 
o appearance ar i Š 
prowess, e concerned with physical 


a Manifest Anxiety scores were 
was mint part of the total test battery, it 
tween ee to obtain the correlation be- 
‘heativels aylor scale scores and the most 
icator” © cathected items, the “anxiety in- 
lationshi a Results indicate an inverse re- 
and an etween “anxiety indicator” scores 
~ 40 f ifest anxiety. The correlations were 
attitude t men and — .53 for women. Low 
cantly a oward body appearance is signifi- 
E A ore beyond the .01 level, with 

anxiety. The difference between the 


correlati 

ations fi 5 
i or m i m 
nificant, en and women was not slg 


Reli, sya 
‘ability and Relations of BC and SC 


and SPitchalt reliability reported by Secord 
Cated urard for the BC and SC scales indi- 
the internal consistency of the scale 
a no indication as to the stability of 
of hig the body and self over @ Pe 
aft ime. Retesting of the 52 male sub- 
he a 6 to 8 week interval made pos- 

e obtaining of the test-retest coeffi- 
ka reliability. These were .72 for BC, 
t SC, and .76 for the “ansiety indi- 


attit 
riod 
jects 
sible 
cients 


Table 1 


Mea; 
sa Standard Deviations, and Comparison of 
ifference Between Means for Sexes 
(N=52 Males; 95 Females) 


B Tat Mean SD CR 
ody cathexis 
ales 
Females oe et 2.13* 
elf Cathexis i 
ales 
Females 4a = NS 
Diit: ; : 
mee indicator 
es 
Females a a 3.06** 
‘Om, a ” 
i Medical Index 
Female gg.o2; 4436  3.53™ 
. 11274} 32:28 
* Sirni 
S Signipcant beyond .05 level. 


Agni 
tLog anne beyond .01 level. 
nsformed scores. 
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Table 2 


Intercorrelations Between BC Scores and 
Cornell Medical Index 


Body Anxiety 
Test cathexis indicator 

Cornell Medical Index 
Males =33* —40%* 
Females —.40** —.54** 


* Significant beyond .0S level. 
+ Significant beyond .01 level. 


cator” scale. These figures indicate acceptable 
test-retest reliability for the three measures. 

The relationship of BC to SC as indicated 
by Pearson product-moment correlations was 
.66 for male and .79 for females. These cor- 
relations support the findings by Secord and 
Jourard that attitude toward the body is re- 
lated to attitude toward the self. 


Sex Differences 
The means, standard deviations, and com- 
parison of difference between means for the 
listed in Table 1. As the dis- 


two sexes are 
tribution of scores on the Cornell Medical 


Index was skewed with the variability being 
almost equal to the mean, these scores were 
converted to log scores and these trans- 
formed scores were used for all statistical 
analysis (5) 


The student nurses’ attitude toward their 


bodies was significantly lower than that of 
the seminary students on the total a si 
and on the “anxiety indicator scale. itor- 
ence between the sexes on the latter y i 
consists of items pertaining primarily a y 
appearance was particularly striking. ' e : 
cutting scores of 2.8 OF 
above are used for dividing 
61 of the yim 64%, : 
g en have scor 
A T ahera 2%, have scores of 4.0 or 
above while 7, 13%, of the men have scores 
in this range- Thus 64% of the women, In 
o of the men, state they defi- 


trast to 42% € 
nately dislike the appearance of their body 


and only 270; in contrast to 13%, state they 
are pleased with their appearance. Signifi- 
cantly more symptoms were admitted to by 
the student nurses on the Cornell Medical 
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Table 3 


Intercorrelations of Somatic Items on Cornell 
Medical Index and BC 


Body Anxiety 
Test cathexis indicator 
Somatic items 
Males —.24 =31 
Females — 30" -= 449 


* Significant beyond .05 level. 
** Significant beyond 01 level. 


Index, but there was no difference between 
the sexes on the SC scale. 


Relationship of BC to Somatic Symptoms 


The correlations between BC and the Cor- 
nell Medical Index for both sexes are listed 
in Table 2. 

All correlations are significant beyond .05 
level, and all but one are significant beyond 
the .01 level indicating in this sample a 
moderate inverse relationship between atti- 
tude toward the body and number of symp- 
toms reported. While the correlations for 
women are higher than those for men the dif- 
ferences are not significant. For both sexes 
there is a higher relationship between the 
“anxiety indicator” scores and number of 
Symptoms reported than when the total BC 
score is used. This difference is significant for 
women at the .05 level when checked by z 
transformation using the technique for differ- 
ence between correlated 2’s (4, P. 148). The 
difference for the men is not Significant. 

As the Cornell Medical Index is composed 
of items pertaining to both somatic and 
psychological symptoms the question arose 
whether the intercorrelations were a result of 
psychological complaints rather than somatic 
ones. To check this the Cornell Medical In- 
dex was rescored for somatic symptoms only 
and these scores were correlated with BC, 
These results are summarized in Table 3. 
While the correlations between BC and only 
somatic symptoms are lower, all are signifi- 
cant with the exception of total BC and 
somatic items for the men. This reaches the 
.09 level. 
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Discussion i 
. 2 an 
This study cross validates Secord’s 


5 the 
Jourard’s finding that attitude rie a 
body is a significant factor in atti 


; t one 
ward the self. Zachry (10) believes that onè 


1S 
of the most important tasks of adoles 
the acceptance of the body “as a Y ttitude 
self.” These results suggest that T accept- 
toward one’s body is associated wit put also 
ance of self, not only in adolessent a 
in young adults, and perhaps at a sationshiP 

Results indicating a moderate Ma somal 
between attitude toward the body oe theory 
complaints renews interest in Sa narcis- 
of hypochondriasis. In his EHaD ese with- 
sism Freud states: “The hypochon the latter 
draws both interest and libi e g e 
especially markedly—from the es upon the 
outer world and concentrates bot 2” GÈ 
organ which engaged his atenas 
40). Freud believed that this wea 
from external objects and excess oa 
tion of interest onto the sensations mming 
tions of body organs was due a 
back of the libido into the e REE : 
This paper was not designed sp pjects hav! 
test Freudian theory, and the su pypochor 
not been clinically diagnosed z hypothes 
driac, but the results support t is jate 
that attitude toward the body ! 
with somatic complaints. 

The significantly lower B at 
women suggest the attractive RIP 2 
because of the social imponan E a 
male body women are more cri e concer” 
bodies and are likely to be mo nE 4 
over body appearance and functi estigi zi 

9) inv un 
are men. Jourard and Secord ( and {007 
BC and the ideal female figure aspects 
that women’s satisfaction with itude 
their bodies varies with the pie 
deviation between measured E found 
they consider ideal size. They a «idea 
many women feel attainment ° sible- fr 
portions is difficult, if not aa insolat jj- 
tainly seems plausible then t a romen; dy 
this “ideal” is internalized by se id pa 
ure to attain it would result } D be d 
cathexis. The small percentage a7 A pleas 
and women who stated they W 


for 
that 
e fe 


ç scores 
hess 


ee 


Body Cathexis as a Factor in Somatic Complaints 


with the appearance of their bodies indicates 
how difficult it is to measure up to the 
ideal.” 

However, certain factors suggest caution in 
accepting the above view completely. Our re- 
sults are not compatible with Secord and 
Ss (8) with regard to sex differences. 
Ema found no difference between male and 
fins € on either the body cathexis scale or 

me test of body concern. 
com hen the BC-SC scores of this study were 
no para with those of Secord and Jourard, 
eith ifference was found on the SC scores for 
Sen, sex or for men on the BC scale. How- 
abilite a difference, at the .008 prob- 
nise, evel, was found between the student 

iffere and college women on total BC. The 
Not ence between the two female groups was 
to Snificant on items pertaining primarily 
T 1 Ppearance, “anxiety indicator” scale. 
ences factors may be related to these differ- 
Wome between the sexes and between the 
level, of the two studies: age, intellectual 
» and training. 
this st was almost identical for the sexes 1m 
Sopho udy and is similar to that of college 

Pe ores and thus safely can be ruled out 
difero et variable contributing to the 
Safely ces. Intellectual level cannot be x 
stug? C7cluded but as the mean IQ of tpe 

ent nurses was 112, they appear to be 

he dissimilar, intellectually, from stu- 
the ee many liberal arts colleges. Perhaps 
Sexes Ost significant difference between the 

as a women of this og and Sines 
duti and Jourard’s, is the tramins 
that y of the student nurse. Levy (3) noted 
Cern ne factor causing excessive body con- 
and interest in his sample of children 
fte €Xposure to illness or being esP° 
Nt discussions of physical i 


and become 
their bodies 
tudies. Per- 


© str 
Ty + . . 
k cken with various ailments 


ONCer $ 
When ned with the functioning of 


ha ey begin their clinical S$ 
Sian tens 
Stuq a similar phenomenon is present in Pa 
nurses and their low scores OP to s 
Ported ; the larger number of symptoms a 
in is due in part to their exposure 
terest in illness. 
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Summary 


The purposes of this study were (a) to 
cross validate the findings of Secord and 
Jourard that attitude toward the body is re- 
lated to attitude toward the self; (b) ascer- 
tain the stability of BC and SC; and (c) to 
investigate the relationship of BC to somatic 
complaints. Fifty-two male seminary students 
and ninety-five student nurses were adminis- 
tered the BC and SC scales and the Cornell 
Medical Index. A significant relationship was 
found between BC and SC, cross validating 
Secord’s and Jourard’s findings. Attitude to- 
ward the body and toward the self was found 
to be stable over a period of time. A moder- 
ate inverse relationship was found between 
attitude toward the body and number of so- 
matic symptoms reported. Women had lower 
BC scores than men and reported a larger 
number of symptoms. The social importance 
of the female body and the training and in- 
terest of the student nurses in illness are of- 


fered as possible explanations. 
Received July 29, 1955. 
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Stability of the WISC and Binet Tests 


Ila H. Gehman 


State Hospital at Butner, N. C2 


and Rudolph P. Matyas 


Pennsylvania State University 


The present study explored the stability of 
the Wechsler Intelligence Scale for Children 
and the Revised Stanford-Binet Scale, Form 
L, as measures of intelligence over a four-year 
time interval. No information has been made 
generally available to show the long-term re- 
liability of the WISC. The 1937 edition of the 
Binet has not been extensively investigated 
with general populations in this respect, but 
Matyas (3) survey of the literature sug- 
gested that an 7 of approximately .73 was 
typical of test-retest correlations when the in- 
tervals between tests were of such duration 
as to minimize practice effects, 

It was hypothesized that intelligence quo- 
tients derived from the WISC would be found 
to be as constant upon retest after a period of 
four years as would those derived from the 
Binet. The examiners were also interested in 
checking upon the relative efficiency of ad- 
ministration of the two scales, and kept ac- 
count of the time required to give each test. 


Subjects and Procedures 


Sixty pupils in the ninth grade of a junior 
high school in central Pennsylvania partici- 
pated in this study. They were selected on the 
basis that their scores on the WISC and 
Stanford-Binet, Form L, were available from 
research by Clarke (1) completed in May, 
1950. The sample in Clarke’s study included 
85 children who comprised the entire popula- 
tion of three fifth grade classes in the school 
district. Their mean age was 11 years, 1 
month. At the time of the present investiga- 
tion, 60 of the original population were avail- 


1 Formerly Associate Professor 


of Psychology, 
Pennsylvania State University. 


s 
able for examination and their mean 36° "o 
15 years, 2 months. Twenty-nine 0 
pupils were boys and 31 were girls. ; sial 
The WISC and Binet were acne aie 
during the spring of 1954 by three g indi- 
students who had completed courses author- 
vidual testing taught by the peor an in 
Three other examiners who had also these 


: earned 
structed by this same person yen in 
children when they were in fi estig?” 


1950. Testing conditions in the two at pos- 
tions were similar and it was genera of the 
sible to alternate the ocean e 
two tests. Data for the 60 pupils i were 
original sample of 85 in the fifth B; asis 1 
recomputed in order to provide “ieoi for 
direct comparisons of identical subJ 
the two age and grade levels. 


Results and Discussion 


‘ the 
Table 1 describes the composition of first 
group with respect to IQ’s obtaine indi ate 
and second examinations. The mean Jigenc® 
a population with average general in eans W 5 
In the fifth grade none of the erat y 
found to be significantly different nfidenc® 
of the others at the 5% level of CISC per- 
but in the ninth grade the mean ter Ù 
formance IQ was significantly pren cent of 
the WISC Verbal IQ. Sixty-seven ane orm 
the ninth grade pupils had higher 
ance than verbal IQ’s. The oe 
IQ points is almost identical wit on i 
from Delattre and Cole (2) wor tended z 
children of ages 10-5 to 15-7 wa aa dis- 
be above average in intelligence. the ver 
crepancies suggest a possibility that ual d 
and performance scales are not of eq 


0. 


finding 
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Stability of the WISC and Binet Tests dol 
Table 1 


Intelligence Quotients of Sixty Children Retested After Four Year: 
A + hild Tears 


Grade 9, 1954 


Grade 5, 1950 
Mean Age 15-2 


Mean Age 11-1 


|! Test M 

| Binet I ean) _ SF MeanIQ_ SD Difference ’ 

. WISC V 96.17 1429 98.25 
WISC a 96.90 10.84 96.72 ma ae 19 
oa 9087 1319 10323 1444 mele -06 
cale 98.13 11.20 99.82 12.79 aa a 
; i a 

Table 2 


culty 

at 

; Other he older age levels. However, among 
; ulations concerning the cause of the 


iscrepancies it į 
Pancies it is possible that the perform- 
coaching,” 


Correlation Between 1Q’s from Ti i 
B ‘ests Given it 
Fifth and Ninth Grades ra 


met and 
all 1 
OUur-year i of the WIS 


Non 

eý 

oth 
J 


th 
e mean IQ’s were stable 
C over the 


uld tend to 
the first and 
bility is 
f stu- 
els. Even 50, the 


A were marke 
er as ae correlations differing from any 
Sur i determined by transforming the 

res and testing for significance of 


Tabl 


ance i 
' when = is more sensitive to 
system a testing is done in one school Test 
hile Ea is true of the verbal scale. - af 
'S fo an was a slight tendency for the eel i -18 
except in th rom grade five to grade nine WISC Performance T 
tests reach e WISC Verbal), none of the £ WISC Full Scale a 
Thus ched significance at the 59% level. 
i for both the 
difference. The WISC equalled the Binet in 


dependability for predicting itself over the 


four-year interval. 
urther analyzed to find the 


The data were f 
the various scales and to 


intercorrelations of 
see if these differed at the two grade levels. 


Table 3 shows that the abilities or charac- 
teristics measured by the Binet and WISC 
are ordere i ntially the same way for 
both grade levels. The largest discrepancy be- 


tween correlations was found in the case of 
d the Binet with 


the WISC Performance an 
the higher correlation occurring in the ninth 


e3 
etween Correlations 


Intercorrelations of IQ’s and ł Tests for Difference B 
(Fifth Grade Followed by Ninth) 
WISC WISC : 
Perform- Full Binet 
Test ance Scale Form L t 
.83 78 
WISC Verbal a oa a os a 
86 46 
WISC Performance “g4 37 mn 1.39 
73 
1 48 


WISC Full Scale 
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grade. However, none of the differences be- 
tween correlations was significant at the 5% 
level of confidence. 

With regard to administration, Clarke (1) 
reported that the mean time for giving the 
Binet to the fifth grade was 76.8 minutes and 
for the WISC Full Scale 64.05 minutes, or a 
difference of 12.7 minutes. For the ninth 
grade the mean administration time was 69.2 
minutes for the Binet and 55.9 minutes for 
the WISC, the difference being 13.3 minutes. 
At both levels, then, the WISC Full Scale 
averaged about 13 minutes less testing time 
than did the Binet. 


Summary 


Results of Binet and WISC administrations 
were compared, these tests having been given 
to 60 boys and girls in fifth grade and four 
years later to the same children in ninth 
grade. Both tests yielded 1Q’s that were rela- 


lla H. Gehman and Rudolph P. Matyas 


tively constant and showed equal ae, 
over this interval of time as determined y 
comparisons between mean scores, testre 
correlations, and intercorrelations of ma 
parts. On the average it required 13 minu a 
less to give a full WISC than to give a Bin 


at both grade levels. 5 


Received August 1, 1955. 


References 


p he WISC 
1. Clarke, F. R. A comparative study f et rela- 


nd Revised Stanford-Binet, Fo de 
tion to scholastic achievement of a = bis 
population. Unpublished master’s thesis, 
sylvania State Univer., 1950. J 

2. Delattre, Lois, & Cole, D. Comparison 
WISC and Wechsler-Bellevue. J. cons 


of the 
Jt. Ps9- 


chol., 1952, 16, 228-230. Revised 
3. Matyas, R. P. A longitudinal study of published 
Stanford-Binet and the WISC. Univer 


master’s thesis, Pennsylvania State 
1954. 


Journal : 
P o Copsulting Beoukolony 


Intolerance of Ambiguity and Ethnocentrism 


F Ronald Taft 


University 


I A 
e a erion with a study on the auto- 
students cg a group of first-year psychology 
tralia ate the University of Western Aus- 
group situ Chast in both individual an 
ready elgg Since these subjects had al- 
an opportu given a test of ethnic prejudice, 
Other Aa nity presented itself to test in an- 

SA. on ure the previous findings in the 
and intol the relationship between prejudice 

Pontolerance of ambiguity. 

ka the work on this relationship by 
€Monstr, runswik (6), Block and Block (3) 
Centrism ated that persons high om ethno- 
iome ee quick to develop personal 

s in the extent of their perceived auto- 


etic 
tired are es That is, in this unstruc 
ics showe 


litt] 
usi lar findings 
i tained by 


nt prefer simple ra 
"Oh pone figures, and since persons 
Sie to social pressure also show this 
ineti, we hypothesized that in a group 
th ic situation high ethnocentrics would 

conform to their partner’s judgments. 


auto 


Method 


Th ; 
subjects consisted of 36 V 


femal olunteers (21 


ea triss and 15 males). The measure of ethno- 
to ee was a Bogardus-tyPe scale referring 
he ines following groups: American Negroes, 
Ose hai Trish, Italians, Jews Poles. 
aS gre ose average degree of ethnic aversion 
Stroup ater than “Would admit to ™Y soci 
Prejudice personal friends” were regarded as 
iced, and all of the others 3S unpreju- 
author thanks Mrs. Enid Cook for making 
tic effect. 


1 The 
a 
le the data on the autokine 


*Vailab] 


of Western Australia 


diced. There were 11 and 25 Ss respectively 
in each group. Among the subjects used in 
this study prejudice is mostly not extreme 
and only five of the “prejudiced” subjects 
would have excluded more than two of the 
ethnic groups from citizenship in Australia. 
On the other hand, there were 13 extremely 
unprejudiced subjects who stated that they 
would be willing to accept members of nearly 
all groups even as marriage partners. 
Autokinetic phenomenon. Each S was tested 
individually on the darkroom autokinetic ef- 
fect. In the initial session they made 20 esti- 
mates of movement in the presence of EZ, a 
female graduate assistant. Unlike the cus- 
tomary procedure, the instructions included a 
short explanation of the autokinetic illusion; 
the Ss were told that some people tend to see 
“a great deal of movement” and some tend to 
see “only a little” but almost everyone does 
tend some sort. The fact 


that the Ss were tol movement was 


distingui 
described by Block 


that 


each S was 


t as follows: (a) In- 
iouity. Whereas Block an 

rating method of determining 
re established, we used an ob- 
the mean deviation. Because 
e in the individual estimates, 
tion was not a suitable meas- 
had informed the 
ement, the 


153 


154 


mean level of the estimates was used as a 
second measure of intolerance of ambiguity— 
the closer the estimates were to zero, the 
greater the intolerance. These indices were 
calculated for only the first ten judgments in 
the individual situation, in order to focus on 
S’s first reactions to the unstructured situa- 
tion. (6) Conformity to partner. This was 
determined simply by the direction of S's 
mean judgment in the group session in rela- 
tion to his previous mean and that of his 
partner. 


Results 


Intolerance of ambiguity. The more highly 
prejudiced Ss made estimates that were closer 
to zero than did the unprejudiced. The mean 
estimates were 2.3 and 4.9 inches, respec- 
tively; using x° with Yates’s correction the 
difference was not Statistically significant (p 
was actually .10). The mean MD’s of each 
individual’s set of estimates were .8 and 1.0, 
respectively, also nonsignificant with a p of 
10. However, when we combine these two 
indices we obtain results that are significant 
at the .05 level. Thus only one of the 11 
prejudiced Ss, compared with 12 out of the 
25 unprejudiced, recorded both mean esti- 
mates and mean deviations above the median 
for the group. We seem justified therefore in 
concluding that the prejudiced Ss are less able 
to tolerate ambiguity than the unprejudiced. 
A more detailed analysis of the results pro- 
vides no indication that the relationship is 
other than linear between the very unpreju- 
diced and the very prejudiced Ss. 

Conformity to social Pressure. Results on 
the conformity index were available for only 
21 Ss (7 prejudiced and 14 unprejudiced), 
but the trend was a definite one, The un- 
prejudiced Ss tended to move away from 
rather than ¢oward their partners. Only 6 out 
of 14 unprejudiced Ss converged compared 
with 6 out of 7 of the prejudiced Ss, This 
finding lends further support to the expecta- 


Ronald Taft 


tion that prejudiced persons are more a 
pendent on their group, especially in e 
structured situation. Once more this 
was a linear one. 


Conclusions 

that those 
higher 0 
d fo adopt 


Further evidence is provided 
subjects who are comparatively 
ethnocentrism are also more incline unstruc- 
an anchoring point quickly in an sed in 
tured situation. The anchoring points ba a 
the above experiment were zero pore one’s 
steady personal norm, and the no e gen- 
partner. These results support Da ongruent 
eralized dictum “Ethnic prejudice 1s € ment in 
with minimal resistance to the een is 
which stereotypes are accepted, th! of ab- 
eschewed for conformity and security 
solutes” (4, p. 14). 
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A WISC Profile for Retarded Readers 


Grace T. Altus 


Santa Barbara 


This į , 
tes oe stigation posed the question: Is 
with the a test pattern associated 
a Seer the Wechsler Intelligence 
Severe readi 1 dren (WISC) for children with 
Syet ng disabilities? 

ned as sp ii disability was here de- 
etween a raat | of two years or more 
as derived ae child’s expected reading level 
kee a Full Scale WISC 1Q and 
Standardi reading level as measured by & 
sample a reading test. All children in the 
partment been referred to the Guidance 
Chools h of the Santa Barbara County 
academic A their teachers because of severe 
6 isabilities, All had Full WISC 1Q’s 


o : 
haq Pe ling spoke only English at home, 
Wisc n at least four subtests On each 
d and 


“ghth is ale, and were between thir 
ee when given the reading test. 
ols Lg 25 children from 12 elementary 
were b these criteria. Twenty-four © 
f the oys—an exaggerated representa- 
a i finding that boys outnumber 
© groy ing problems. The intelligence of 
3 8, ine was normal. Mean WISC 1Q’s were 
ance, oi and 98.6 on the Verbal, Perform- 
ae Scales respectively. There was 
Cted ility in the sample than in an un- 
deviati Population as shown PY standard 
the earns of 9.9, 10.3 and 9.2 IQ points on 
ite scales. ` 
tepane the mean Verbal-Performanc®e JQ dis- 
ifferent; was negligible, it was clearly not 
Patten a diagnostic. However, the subtest 
Shown >S appears to be fairly distinctive, 4S 
eime eh Ceding and Arithmetic 
Span Pi cantly lower than Vocabulary, Digit 
» Picture Completion, Object Assembly, 


i 
Cture Arrangement at the . 


Scho, 


Sele, 


County Schools 


confidence. The Information subtest is sig- 
nificantly lower than Picture Completion at 
the .01 level and lower than Vocabulary and 
Digit Span at the 02 level of confidence. Had 
the positive correlations among the various 
subtests been taken into account in computing 

f differences between subtest 


the significance 0 
means, the chances of true differences would 


have been increased and Similarities would 
been included in the “low” 


probably also have 
subtests. 
ee a Ne fe | 
mi 
ank 
W 
a 
9 
a 10 
a 
a 9 
ô 
a8 = a: 
FE PA ED OA C 


LU 


WISC subtest scaled scores of 


retarded readers. 
ern is strikingly 
eported by Altus (1) 
ing the differential validity of Wechsler- 

ubtests in predicting graduation of 
m a camp for illiterate soldiers. 
Information, and Digit Symbol 
(Coding) subtests were there shown to be 
highly effective in predicting graduation, i.e., 
achievement of technical literacy. 

Thus the same subtests which are here sig- 
nificantly lower for children with severe read- 
ing disabilities were also lower for adult sol- 


Fig. 1. Mean 


obtained WISC patt 


i the findings 1 


trainees {ro 
Arithmetic, 


155 


156 Grace T. Altus 


diers who failed to read at a specified level 
after instruction in reading. The consistency 
of the findings suggests that the profile herein 
described, while based on a small number of 
cases, may be reasonably characteristic. 
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Reviewed by 
Roy Schafer 


Corporation, 


Yale University Medical School 


The 
has 11, )Vechsler-Bellevue Intelligence Scale ( 


W-B) 


and through this it better 


of verbal self-expression 
interest in verbal organization and com- 


defines his i 
munication of experience. On the other hand Infor- 
ntains two items that overlap Com- 
prehension (“Why are dark clothes warmer than 
light-co! “How does yeast cause 
dough to rise?”) ; also Comprehension now contains 
three items that overlap tests of concept formation 
(three proverbs). Thus, not all the changes are in 
the direction of greater homogeneity within subtests. 
Also commendable is the extension of the test's 
important respects. (a) In most of 


range in thre! 
ver levels of intellectual function may 


| ad i i 
a ag it i lifted. In form and substance ae the subtests, low 11 n 
bon) Intelligence Sc a? = er bane now be tapped and sai = i incapa r 
thas ae no new t; a n ree It tructure, like intellectually n e HA D) The’ : 
Ee of the W-B gts he subtest. ts s e iea upper levels have also been na : W e age 
pailysis of tire 5 , makes possible ae as rete range covered by the test has o nen upward 
a tha on of ee subtest scores, but a sof B the establishment of norms throug oe 70- 
tiv Equence of he iy en E 3 es rela- 74 and ever mp me nebulas AIS a il 
hale hd and failures et NETA and over.” Unlike N B rae a nae Py 
fae and aata subtest a ne h sees ted cover the 26° Sr a Lange “does that job. In 
Solutions itative analysis a i P telligence Saale Sake ere raise is due for the 
ie to whether th ifti much for connection wA EEY, ae weighted subtest 
Wri test, my im e fane oi aE ap ne f old pea Tp ak. corrected for age. This 
posites Sone pression is mixed; it 1$ one p i scores may be, so ke conrecring subtest per- 
wae qe and new ones added and ae eia “correction” iS achieve "Ie the Subjects age peers 
Li Is remains ones added. Viewed emn Da z formance with the aver With the average of the 
cee certain ae ne best clinical instrumen c ne rather tha compa is aged 20-34. Diagnostic 
in ation, and unctions, such as eo i spate standard reference a ol der age ranges especially 
tion, tively wh poor garenon e 1 Teak ie scatter anny e ne these supplementary tables. 
s, inica] -structured, impersona! a nA may well be furthere 7 enion is that the stand- 
< rd Onlined aA must study ren stations in (c) The third ee n includes Negroes an 
Der tS complet ai conventionale ss survey ° ardiza ponts A and the sample was drawn 
| Dejo ality A e in each case their gr° linical ex- rural-agricultur p-> country: We therefore 
lence y+ rganization and dynamics. Clinica a from over the entire © ee our highly 
Schach _ With a batt f tests, including the Ror- he test with more confidence i 
te ch and TAT ery of tests, tates that poth apply the | a] populations. (it would be most inter 
begets of Wi Ji age! gemors test contribute varied ohne es reakdown 0 he data in terms of 
| Stren ata b th sler’s intelligo nificant areas 0 esting to S° Tq Negro-White, #8 well as male-fe- 
funceth and ni a SAE S g adaptive urban-rura’; 
or pe dting atid ee nee we ee dearer of strengt! male.) of the subtests have been lengthened. For 
+ in Pathological i sume pE y gee ti syed blessing. On the one hand, 
ar Studying he impairment 19 these areas. gitions clinicians this 15 a ne the test more time-consuming, 
© these orderline and acute psychotic Ca greater jength makes ies tation to drop subtests or 
all ue a anlions important. the and th increases the tempi a n T ther hand 
l oon reme improvement on t -B.T e toneg short form of the test; on the other hanc, 
{ ranr A mostly Yeye greater I H a broader Sm cay 
cal? assion l no ran, o: "tere. he W-B Vo- in each subtest Fr Si 5 together with the WAIS’s 
mrotlary » calamity, and fortitude). a piri and Increased score relia y, tog 
‘illo ts contains more items (like harakiri, vy higher correlations between subtests and between 
wats pee single subtests and total test score, means on the 


i 
te) overlapping Information. 


ar, 
Y more directly surveys the SU 


158 


average a narrowing of individual scatter of subtest 
scores. Consequently lesser amounts of scatter will 
now tend to be significant. However, this change 
may be more or less offset by the slight expansion 
of the weighted score scale (0-19). 

The goal of eliminating ambiguous W-B items (p. 
1) appears to account for the replacement of a 
number of items throughout the test. This revision 
too is a mixed blessing. A degree of ambiguity (or 
whatever makes for disruption of response—as in 
the frequent Information error that there are four 
pints in a quart) adds “projective” richness to in- 
telligence test results, Ambiguity highlights the way 
repressive uncertainty limits and undermines intel- 
lectual attainment; it pinpoints confusional tend- 
encies; it provokes obsessional rumination; it facili- 
tates anxiety-laden temporary inefficiencies. To the 
clinician, misunderstandings and inefficiencies are not 
random events; they point to significant patterns of 
functioning. We must remember in this regard that 
there is no one standard for choosing items to study 
intelligence. In our lives our “intelligence” must cope 
with tasks involving all degrees of Structure, all de- 
grees of conventionality and familiarity, all degrees 
of complexity, all degrees of value-loading and con- 
flict-relevance. It is in this sense that the Rorschach 
test becomes in part an intelligence test too, though 
it yields no Precise score. Wechsler’s psychometric 
approach to item selection almost necessarily favors 
as “well conceived” items that are easy and quick to 
administer and neatly scorable. But rounded clinical 
Practice requires a description of more than IQ 


level; it concerns itself with intellectual potentiali- 
ties, ambitiousness, 
hibitions, 


Throughout the Presentation of the WAIS it re- 
mains clear that Wechsler’s approach to intelligence 
is limited by psychometric considerations, Dynamic 
considerations are underplayed. Concrete evidence 
for this is found in the crowded test blank which 
discourages verbatim recording and detailed qualita- 
tive notes. Similarly, the test manual completely 
ignores the many problems of technique so fre- 
quently encountered in clinical intelligence testing. 
What should we do when the subject too quickly 
gives up on items? How might we spot and follow 
up the implicit concreteness, misunderstandings, per- 
ceptual distortions, or bizarre conceptions often un- 
derlying responses? The WAIS manual even discour- 
ages clinical probing or testing the limits (p. 28). 
From the standpoint of getting an IQ that conforms 
neatly to the WAIS standardization, this discourag- 
ing attitude toward flexible and imaginative test ad- 
ministration is understandable. When, however, we 


Psychological 


Test Reviews 


use the test to help understand an individual as W 
as to help estimate his general intelligence le aide 
need the standard administration as a inevitably 
rather than as a set of parr gee ma Be 
we must go beyond this guide, not rashly at 


ia dom th 
quently but with that sophisticated free helps 1 


helps us study response as ae of logi- 
clarify diagnostic and dynamic implica ses. For && 
cal or emotional disruption of responses. for 


: zed subjects +% 
ample, anyone who has routinely asked ic 


x two Pi 
ies they have in mind on the last orrect 
the storii y nc 


ture Arrangement items will know how wen 
sequences are not backed up by a com 
standing of the stories, and vice versa.. ulties in its 

While recognizing the practical ci of subti 
way, I am sorry to see that no new typ in crying 
has been introduced. There is, for gas maeaningit 
need for a test of immediate memory yA not satis 
material; Digit Span and Digit Symbol seit e, there’ 
factory in this regard. It remains desitt 
fore, to supplement the aamuna a i 
with a Story Recall test such as that : 
Test for measuring mental agerenge i, that 
changed—and unchallenged—is the Veyer al” a” 
breakdown of the Full Scale IQ into e 
“Performance” components is er pee o 
factory. Inspection of the pons : ihat Digit Fot 
tions (pp. 15-17) makes it eviden or extent g 
particularly and Arithmetic to a Je subtests- 
cluster with the other four vats mie is 
performance on Digit Span and Ari Jn derivine ot 
tively vulnerable to psychopathology. 


e 
o 
aka ice we therefore 
Verbal IQ in clinical practice we th ] verba 


t under- 


by omitting pathologically 
or dollinaeele spans and then extra : th 5 
desirable change has not been aa continue? y 
part credits in the Block Design ey tha 
limit the sensitivity of scoring i s on suiti 
wonder, by the way, why the co oe t pe 
were changed. Such a change disrup Is 
of our experience with test erie 
the promised revision of The Ges agate 
Intelligence will account for this 

others that are not self-evident. 


s W: 
Clinicians will find it easy to SV tent 0 


W-B to the WAIS. Although the a type da uld 
number of items has been chañgad, í changes sy w 
remains the same throughout. Ca the subtes, the 
be stressed, however: (a) some 2 (b) some o and 
structions have been reformulated ; rehensio™ fpe 
criteria for scoring Information, a the peen 
Similarities items have been altere items have „nd 
limits and bonuses on performance i Defectiv® 
revised; (d) the IQ limits of eas d. nica! 
Very Superior ranges have been ¢ definitive © op: 
I must say in conclusion that er 0 de of 
assessment of the WAIS must aw: Jer’s review 50 
ments: (a) the appearance of eee ae 
his book, for at the present time pout the phe oug 
much more than the rest of us al e 


ge OF 7, yar 
nology of the revised test; (b) rs a wide 
time to allow the WAIS to be applie 


est 


nile 


ee 


kd 


ia 


Psychological 


riet; ; > 
ae subjects in routine clinical practice and in 
a ae TA This review is thus no more than 
from the a my initial orientation while switching 
of the eee the WAIS. A follow-up appraisal 
in order. ý ve years from now seems definitely 


Reviewed by 


Quinn McNemar 
Stanford University 


This revisi 
e EA E (called WAIS) of the 1939 Wechsler- 
tures of th elligence Scale retains the distinctive fea- 
items ae original. About two-thirds of the earlier 
the Avera survived the rigors of item analysis and 
217 to 257 number of items has been increased from 
Over the , but this increase is spread so unevenly 
Digit Synths btests (23 of the 40 added items are 
total Scale ol items) that the effective increase in 
abulary t length is less than 10 per cent. The Vo- 
integra] est, consisting of entirely new items, is an 
e a of the Verbal and Full Scales. : 

age from 16 ardization sample of 1,700; ranging in 
tive, It iş to 64, is claimed to be truly representa- 
8eopraphie + Stratified sample with controls on sex, 
Ma nonwhit egion, urban-rural residence, race (white 
saw in th e), occupational level, and education. A 
inability p Sampling procedure was the (admitted) 
reviewer ah select randomly within the strata. The 
tro Uced hee the author’s belief that any bias in- 

is : failure to follow the ideal random 
the mall. In other words, the reviewer re- 
ked ; standardization sample as excellent, a 
and Over ovement over that for the 1939 scale 
Sa the norm groups for other scales of the 


cases ranging in 
des the basis for 
claims are made for 


: it represents a 00 
bee resis ea city (Kansas City, 
poket a s for the 101 cases in 
he ma Te very similar to those of th 
is ye Sample, 
Pro = Wechsler has paid ™ ition | 
Dj: Prese m of test reliability: split-half reliabilities 
sit S nted for each of the 11 subtests (except 
ean ie) for each of three age groups- e 
Median pq 73n8e from the 60's to the 90'S, with a 
me ie of .82. The reliabilities for Verbal, Per- 
» and Full Scale 1Q’s are reported as 96, 
“tical -97, respectively. The reviewer js somewhat 
of these three coefficients, and hazards the 


Dredi 
„edicti; 
high, On that test-retest reliabilities will not be as 


Sin 


Mo.) and 
the 60-64 age 
e same age in 


the ore attention to 
are 


ite une 
= pe A is built on exactly the same base as 
iples iden it must be presumed that the prin- 

erlying the old scale are being propagated. 


Ti iew 
est Reviews 159 
ae the author of WAIS shows no 
ae wee e vast factor-analysis literature of 
past 2 years. Regardless of whether one identi- 
fies with some sort of g school (typically British, 
apparently adhered to by Wechsler) or with 
primary ability (differential aptitude) approach 
one cannot escape a lesson regarding test pee 
rs geome forcefully from the factor litera- 
n i : = porisenictor should strive for a pure 
easure of whatever he hopes to quantify. That is, 
a score should represent a point on a unidimensional 
scale rather than a hodgepodge of different dimen- 
sions. 

Consider so-called Verbal 1Q’s obtainable on WAIS. 
Two persons with the same total weighted score on 
five of the tests can readily differ by as much as 10 
points on the Digit Span or 6th test, thereby differ- 
ing by 10 points on the Verbal IQ scale. Apparently, 
the user of WAIS is expected to condone such pos 
sible qualitative differences among Verbal IQ's, dif- 
ferences which are further complicated by the con- 
tinued inclusion of the Arithmetic test as one of the 
measures of verbal ability. 

On page 13 of the Manual a word of caution is 
injected regarding the possible unreliability of dif- 
ferences between scores on two subtests (same indi- 
vidual), but when we reach p. 18 we learn that 
“differences as large as five points may be unusual 
enough to be noteworthy.” This statement, which is 
based on the statistical fact that the median value 
of the standard deviations of the 55 distributions of 
difference scores “was approximately three,” ignores 
two other statistical facts; namely, the standard 
deviations (none of which is reported) vary from 
about 1.9 to about 3.6 and the reliability of the dif- 
ill vary considerably among the 55 
res. And some of the reliabili- 
ties for difference scores will be disturbingly low (in 

60's). Since difference scores have been 

in clinical diagnosis, the 

failure of the author to inc Manual reli- 
ability coefficients and ba of meager for dif- 

scores is absolutely inexcusal e. 

E: ae opinion of the reviewers the author of WAIS 
A ible task: the construction 

(global) intelligence 
ide differences 
value. The 
t and yield 
atisfactory 
are not 


yield 


eleven su 
jntercorrelation: 
realization of 
diverse enough 
the low interco 
ference scores. 
New Tests 

Charlotte, & Mandeville, Kathryn. The Five 
T). Ages 9-13. 1 form. (20) min. 
Record booklet ($7.50 per 50); set of colored pads 
($4.00) Ball-and-field pad ($2.00) ; manual, pp- 
24, mimeographed ($3.00) ; complete set ($15.00). 
Beverly Hills, Calif.: Western Psychological Serv- 


ices, 1955- 


Buhler, 
Task Test (FT: 


160 Psychological 


Buhler’s “five tasks” are related performance tests, 
which are reported to have some relationships to emo- 
tionality and organic brain damage. The first three 
tasks are to cut a circle, a heart, and a star from 
four-inch squares of paper. The qualities of the prod- 
ucts are rated against scaled specimens, and the num- 
ber of scraps is counted as a measure of “emotion- 
ality.” The fourth task is cutting “anything you wish” 
and is given a projective interpretation. The fifth 
task, the Terman ball-and-field test, is rated as nor- 
mal, borderline, or problematic with the aid of scoring 
specimens. Like many other behavior samples, per- 
formance on these tasks may give a sensitive and 
alert psychologist many clues about a child’s typical 
responses to his world. The evidence supporting 
these particular tasks as clinical instruments is weak. 
No data on reliability are given; the very moderate 
reported validities were tested against inadequately 
defined criteria. Perhaps the test is worthy of fur- 
ther research; perhaps it will remain a subjective 
instrument of some value to clinicians who depend 
on observations and hunches rather than on scores.— 
L. F. S. 


Buhler, Charlotte, & Howard, Gertrude. Personality 
Evaluation Form (PEF). 1 form. Booklet ($3.50 
per 25) with manual, pp. 11, mimeographed. Bev- 
erly Hills, Calif.: Western Psychological Services, 
1955. 

Described by its authors as “a technique for the 
organization and interpretation of personality data,” 
the Personality Evaluation Form is a 12-page book- 
let consisting mainly of a series of headings with 
blank spaces for entering data, inferences, and con- 
clusions. As an outline for case study, the form has 
some merit. Like all such blanks, however, it lacks 
flexibility. In attempting to meet the requirements 
of all situations and all clients, it inevitably pro- 
vides too little space for some topics and too much 
for other less relevant issues. Somewhat dangerous 
is the implication that it may be used by teachers 
with little psychological training. Well-trained cli- 
nicians hardly need such a blank; others should not 
attempt its use—L. F. S. 


Cooperative School and College Ability Tests 
(SCAT). College entrants and freshmen, 4 forms; 
grades 10-12, 2 forms. 70 (100) min. Test booklet 


Test Reviews 


pp. 14; hand-scor- 


($3.25 per 25) with directions, nave (35 i 


ing answer sheets ($1.25 per 25), 


IBM answer sheets ($1.25 per 25), keys Gen 
manual, pp. 57 ($1.00). Princeton, N. Jy bie 


Angeles, Calif.: Educational Testing Service; 


The new Cooperative tests are an impressive He 
tribution to the development of a groupiadm 
tered battery designed for the limited but fng ve 
function of educational prediction. Each Ba i 
tains four parts—sentence completion, T solie 
numerical computation, and numerical pno from 
ing—selected for optimal concurrent ye panel 
among nine types of items recommended A abal 
of test specialists. Three scores are obtained, 
quantitative, and total, each expresse! a 
of three-digit scaled score and interpreted a 
percentile norms. Currently available are ‘ or with 
of Test 2 for use in the senior high soho 3 
superior ninth-grade students, and Eo an 4 
Test 1, two of which have reste SEN 
for college entrants, freshmen, and sopho additional 
ther research is under way to aap a 
levels, all with similar types of was a 
down the educational structure as the fo 


grade: lled as 


Pi 
Jestly Jabe Te 


re al n 
taining two subtests and regüip mp i with r 
has a reliability of .91 and correta 
longer test. Validities are presen am 
concurrent correlations with mar ai 
jects; predictive validities are to 


future studies. A valuable feature is t 
es ani 


scho 
ptaine js 0P 


graphic device for showing tian a absolute ‘ind 


probable range of ability, n° vide F 
The provisional norms are based pee and v0 
of about 9,000 students in high sc an 
2,500 in colleges. led ra 
Few psychometric devices have oe cons! uch 
SCAT in the sophistication of the te ay W } 


research, and in the scope and 
the data are presented—L. F. S: 
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Response Set as a Suppressor Variable 
in the OAIS and MMPI 


Benno G. Fricke * 


University of Michigan 


This article j 
Set to ae is concerned with a test taker’s 
Yes,” “true ae particular response category 
ii (5, 6) or “agree.” According to Cron- 
Ponse sets th who has reviewed several re- 
Or, the var at influence a test taker’s behav- 
Set Ciise uae generated by the response 
nce, ag is regarded as undesirable 
tor varian ing to him, it contributes only 
© usefulness and cannot be used to increase 
erent Ri ae of a test. In this article a dif- 
ence, will nale, supported by empirical evi- 
Onse set ee how a measure of this re- 
many Sine be used to improve the validity 


Nature of the Problem 


Imb 

Has Hi ang in scored responses. 

atts or get scored in most 

iones ite es reveals that the signi 

the “Yes,” prenont in one direc 

eo 100 item tue,” etc. For example, 96 of 
s in the Cornell Index are keyed 


Yes» 
> and z 
47 of 60 items in the hysteria 
{ultiphasic 


sca 
e, sonality Fe the Minnesota M 
ie” X nventory (MMPI) are keyed 
tity of me other tests in W. 

scored responses fal 


tic 
Be. Nè 
SYcho] sponse category are th 
the Humm- Wads- 


W ogi 
Orth gical Inventory, Mi ‘ 
the Minnesota 


a 
Vouter 


An inspec- 
personality 
ficant re- 
tion— 


e 

AR erament Analysis, 

ational titude Inventory, 

Co Sel ret Blank. 
Mtention e as a suppressor variable. The 
This ere is that when the number of 
arti 

p testa le was prepared in connecti 

Uarte ourse taught by the writer 

Fello Part i a University ° 

Wship, is Ford Foundation Teaching 


scored responses is unequally divided bet 

all possible response categories the ah 
response set may be substantial. If res a 
set per se is not directly related to an 
terion, it operates to introduce error in the 
criterion-predictor. This is usually the c: > 
If, however, response set is related to raed 
variable that is related to the criterion ‘hen 
response set may be used as a suppressor 
variable (14, 17, 18, 19, 21, 22, 25). By sup- 
pressing or removing the influence of response 
set from the criterion-predictor an improve- 
ment in test validity can be effected. 


Attitude, and Interest Survey 


nality tests validated 
c achievement discloses 


The Opinion, 


that for the 

predictive of high achievement is usually 
false, no, OF disag 
found in an i 
Attitude, and 


constructed by the writer (7, 8)- Results 
from the OAIS will be used to illustrate the 


major thesis of this paper: 

Criterion group responses. 
groups used for the OAIS ite 
340 achieving and 473 nonachievi 
man men in the College of Science, Litera- 
ture, and the Arts (SLA); University of Min- 


nesota. The groups were equated for tested 
academic ability (ACE), and all had ACE 
percentile ranks above 54 on university fresh- 


man norms. Of the 12 
ments only 33, or 26 per cen 
high achievement if answere' 
negative reaction to some statements should 
be indicative of high achievement is difficult 
to understand. The statements in the OAIS 


The criterion 
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are not concerned with study habits and atti- 
tudes. Typical statements and the response 
predictive of superior achievement are: 


Too much fuss is made over famous people (F); 
Often I wish I had more freedom (F); Most people 
have a very good imagination (F); I often find my- 
self imitating someone I consider superior (F); Peo- 
ple should go to church more than they do (F); I 
enjoy sleeping during the day more than at night 
(F); Td rather be thought of as unusual than nerv- 
ous (T); and Marriage before the age of twenty is 
usually foolish (T). 


Interpretation and effect of imbalance. The 
writer originally held the view that the im- 
balance of true and false items was simply a 
function of how the statements were written. 
But this seems unlikely since on some tests 
(e.g., MMPI) having scales for several per- 
sonality dimensions, the scored direction is 
different for different scales. The nature of 
the criterion groups, not the items, is prob- 
ably responsible for the imbalance. The pres- 
ent interest is not in why criterion groups re- 
spond the way they do but in the effect of a 
strong response set. The specific question is 
“Can a measure of Tesponse set be used to in- 
crease test validity?” 

It is obvious from the scored direction of 
statements in the OAIS that a test taker not 
teading the statements but marking false as 
the answer to all statements would receive a 
good score (a standard score of about 90). 
His high criterion-predictor score probably 
does not describe his “academic” personality. 
A test user viewing his score would usually 
overpredict his academic achievement. An- 
other student having a “legitimate” response 
set for saying true would tend to mark an 
abnormal number of answers predictive of 
low academic achievement. 

A measure of response set. One index or 
measure of set for answering “true” could be 
obtained by counting the times a person 
marked “true” to statements in a test. This 


method was used by Humm and Wadsworth ` 


(15) to get a measure of suggestibility or co- 
operativeness. They counted the times a test 
taker answered “no” to questions in the 
Temperament Schedule. Answer sheets hay- 
ing a very large or a very small “no count” 
are not considered sufficiently valid for fur- 
ther analysis. According to their suggested 
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T 
cutoff points, 30 to 60 per cent of the a. 
sheets would be rejected as invalid (1, a 
A much more sensitive index of responsé ‘ot 
would be a count of the “true” Hepa y 
those statements which 49 to 51 gee 
the test takers mark true. For sae onan 
ments there is no general ERE at 
answer; they have maximum a Ei 
ity.” A person without a response o wr 
respond true as often as false on ha thought 
A person with a high score could A Jow 
to have a strong set for marking tru 


e. £ 
. shoul 
score would indicate the opposite. It 


any Ch 
scale are selected independently bee! it 
terion external to the test. In p a scal 


difficult to get enough items to To ial- 
at the 49-51 per cent level of a 
ity. Accordingly, it was decided an 

the “true” response-set scale, oe 
statements in the OAIS which “a a phe 
cent of each criterion group iene d 
Set T scale consists of 69 a 
in the true direction. Typical 5e 
ments are: 


nts score 
state 


soni 
¿ative pet 5 
My friends consider me to be a talka peo 


pene eat So 
I do many things just to avoid pore I ners 
ple like to be considered rude an rd me 2 H 


ing a lot of patience; I’d rather Sal person 
a conversation; I am a very E e 
Routine things require too muc! dictat. To 
predi 

Use of the Set T scale as a ai ise a 
determine whether Set T cou a it were | 
suppressor variable, scores in oe from 
related with the scores ee from the 
grade-predictor scales consin i with th 
item analysis of the OAIS, samen in S s, 
honor-point ratio (HPR) of fres a scales 2 
The first of the two ae e po 4 

iliar 

was based upon the Samia vies the c o 
(true or false) item analysis; 


figu" . 
scale, C, was based upon a ne a cori? 
sponse item analysis which ere con 
simultaneously three response statistic’ ; 
and one intensity) (7, 9). T Ta a CroO 
ported below were obtained o 
validation sample of 209 males TE 
OAIS as part of the regular e C pejor? 
man test battery at least six wee 
beginning of fall quarter a PR, ^: 

Set T correlated — .036 wit 


uset” i 


£. DREE A 


po EEE eae eee 


r a 


Response Set as a Suppressor Variable 


= S, and — .505 with C. The r of S with 
PR was .326? and the r of C with HPR 
was .376,3 
Rea see whether a combination of Set T 
oTe and grade-predictor scores S and C 
cienc result in an increase in predictive effi- 
tency, a multiple correlation coefficient (R) 
Was computed. 
tae he R of Set T and S with HPR was 394; 
R of Set T and C with HPR was .427. 
T eaeag in both cases is appreciable. 
Poll weighting of suppressor and cri- 
the A predictor. It should be pointed out that 
will e of the corrected predictor with HPR 
aaa these R’s only when the optimum 
vunt of the suppressor, Set T, is added to 
r tkole predictors, S and C. If the 
sim pee and the uncorrected predictor are 
et Y added, they are weighted according to 
iran ee deviation. Several “trial and 
i eee will usually lead to an ac- 
addeq e fraction of the suppressor to be 
Weightie the uncorrected predictor. Optimum 
Probabh, g of suppressor and uncorrected scores 
twee, y should result in zo correlation be- 
i the suppressor and corrected scores. 
> te first Set T scores were added to S and 
sing sulting in APS’ (academic personality- 
emic response analysis), and APC’ (aca- 
sis) opp stsonality-configural response analy- 
10.9 he SD’s of Set T, S, and C were 78, 
that’ gar’ 12.3, respectively. It will be noted 
et T is weighted more heavily in APS 
JS simple addition of scores. The r of 
with Pith HPR was .351, and the r ot APC’ 
. HPR was .404. Since these validity co- 
ts (7s) are lower than the R’s ob- 
above it can be concluded that the 
redictors, S and C, were not weighted 
ly with Set T. The r of Set T with 
Was .25 and the r of Set T with APC 
a which indicates that Set T iad 
as ted too heavily. However when .7 St 
With added to S to form APS, the ” 9 Al 
APS , R was .38; the 7 of - 
vas — 01, When .8 Set T wa 
ACE percen- 


for the sub- 
Jow 55 


taine d 
Stade p 
ODtin 

AP mal 


Was 
Weig 


ns 

tile mae subgroup (N = 138) with 

Stoup ove 54 the r was 41, am AS 

"ie Pis E with ACE percentile ran 

low KE PS here were 44 and .20 for the 
subgroups respectively- 


high and 
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C to form APC, the 7 of APC with HPR was 
.41; ther of .8 Set T with APC was .01.4 For 
practical purposes, the influence of response 
set has been removed from the criterion-pre- 
dictors as evidenced by the near-zero r with 
the suppressor. The important point is that a 
measure of response set, Set T, can be used 
to increase the accuracy of grade predictions, 
even though scores from it are not directly 
related to grade achievement. 


Similarity of Set T of the OAIS 
and K of the MMPI 


Construction of the K scale. Since the Set 
T scale of the OAIS functions as a suppressor 
variable, its relation to the K scale (18, 22) 
of the MMPI is of interest. It will be re- 
called that 22 of the 30 items in K were ob- 
tained by comparing responses of 50 psycho- 
pathic patients having a high Z score and a 
normal MMPI profile, with responses of 604 
normals (339 Minnesota men and women, 
and 265 college men and women) which were 
used in constructing other MMPI scales. The 
other eight items were selected from a study 
of faked responses (18). The 22 items will be | 
referred to as Le items, as Meehl and Hath- 
away designated them, and the remaining 
eight items as “fake” items. me} 

Structure of the K scale. An examination 
of the direction of scored responses 1m K re- 
veals that 29 are false and only one is tae 
the true item is from the Le items. A sar o 
the percentage of true-false epee | 
604 normal cee a eet 

ercentage V 
eal 268 college cases. Since not all norpa 
responded true oF false to each item, E T 
«2? responses Were added to the true . 


i 30 
This crude anaa aan a of the 
i re answered true 0 
a ‘he normals: Without addition of pat S 
«p? responses there are still 10 of the 


with A 


so .12. A 
tion it is of some interest to find 


jn Gough’s personality scale to 
ake a good impression (11), 31 


+The r of APS CE was -125 the r of APC 
ith ACE was al: 


that 0 Mt 

measure ability to m 
red false. 

as Tie writer is grateful to Dr. S. R. Hathaway for 

supplying him the percentage frequencies for the two 


subgroups. 
> 
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items beyond the arbitrary limits. Only one 
of the Ls items is not within a 36—64 per cent 
range. This item is: “I have very few quar- 
rels with members of my family.” Only 18 
per cent of the normals give the “plus” re- 
sponse; this K item is scored fre. Six of the 
eight “fake” items fall outside the 40 to 60 
limits, but two (60.3 and 60.5 per cent) al- 
most qualify. 

For practical purposes 22, or 73.3 per cent, 
of the items are in the controversial range; 
but strictly speaking 20, or 67.7 per cent, 
meet the requirement. 

These percentages by themselves are not 
important if approximately two-thirds of the 
items in the MMPI are within the 40 to 60 
per cent limits. An examination of 495 items 
on which data were available shows only 88, 
or 17.8 per cent, are found within the limits. 
Since 20 of the 88 are in the K scale, only 68 
or 14.6 per cent of 465 non-K items are be- 
tween 40 and 60 per cent. If half the “?” re- 
sponses are not added, only 55, or 11.8 per 
cent, of 465 non-K items are within the limits. 
It is clear from this that the procedure used 
in constructing K has resulted in selecting 
items useful for measuring response set as 
described above in the OAIS analysis. It is 
possible that if a different psychopathic cri- 
terion group or a larger number of psycho- 
pathic patients were used for item analysis 
more than two-thirds of the K items would 
have been found in the controversial range. 

Functional similarity of K and Set T. Fur- 
ther evidence on the similarity of Set T and 
K is found in their correlation with each 
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closely than the total SLA freshman ae f 
The test-retest reliability of K for a s | 
sity of Minnesota freshmen was repo teda | 
be .51 by Berdie (2). Rosen (23) TEP en 
.65 retest reliability for psychiatric pa me. 
Hathaway and Monachesi (13) zepon Hath 
test reliability of .66 and Meehl an J oo 
away (22) reported reliabilities of jie OAIS | 
74. It would appear that Set T of cig es 
predicts K of the MMPI as well as 
dicts itself. on 
The oH Set T and K with several i 
MMPI variables are presented in correct] 
The agreement in the 7’s for uae 
scores is quite strong. Minus K, 1a- ons, 
K, has been used to simplify COMP ah in 
The Time score in the table is the ete the 
minutes a test taker requires to Lar simila" 
OAIS. The J (Infrequency) scale titis ob- 
to the F scale of the MMPI in that © yea 
tained by scoring those response 


er cent 
tions which are given by less than ra SRP 
of each of the original criterion ae entile 
is the test taker’s high school ran Java sym | 
transformed to prohibit values. et with + 
bols are not new. The 7’s of Set ae reveal f | 
S, C, APS’, APC’, APS, and AF™ f Set f 
marked similarity in the functio: H wit 
and K. The lower 7’s of Set A stems prob 
scales employing the connus ad rom = 
ably indicate that scores optat ions pecat 


m 


scales are less subject to pistos etc. ple 
of response set, “defensiveness, scales: 2° 
Correlation of K with clinat uncorrect 
2 presents some 7’s of K wI high 2 oy 
MMPI scales. The consistently H8 ort 


ote re 
other. The r of Set T with K for 209 fresh- +s for K with Pt, Sc, and Ma ar P 
man men is — .63; the y for 138 high ACE The r’s of K with Pd and Hs, with HY 7 | 
freshmen is — .58, and the r for 71 low ACE tive, are generally lower. The Pa Tiai ie 
freshmen is —.71. The latter subgroup re- consistently positive and son negate 
sembles the MMPI normal population more than the r’s for Pd. A generally 
Table 1 pman Men , 
Correlations of Set T and K with Certain Non-MMPI Variables for 209 Freshm | 
Variable cy 
Coop: hi? | 
E Ene ‘49 
Suppressor HPR Time I S C APS APC’ APS APC HSRP AC s -hs : 
of = 
Set T —04 —17 -12 -57 —51 25 15 —01 0l o 93-03 
-K —03 —09 02 —50 —38 00 03 —17 06 9 


Correlation: 
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Table 2 
s of K with Uncorrected MMPI Clinical Scales 
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MMPI Scale 


Hs D Hy Pda Mf Pa Pt Se Ma 


Sample Sex N 

Griduintes (18) = a «= € | = = z2 6 —46 -42 
oe m w a ee we i9 -59 —5i —30 
golege (4) uo äp a w a a ee I6 -57 -37 
ey (22) M 100 —30 is 48 -17 — 0 —67 —59 —36 
ormal (22) F 100 T -03 30 —06 — 092 —64 -58 —28 
NP patients (24) M 110 -2 -0 u - 2 oe =e a = 
P patients (26) M 100 "O =e D Ie 15 —30 —25 —10 
Normals (22) M 100 =% —29 11 —26 —08 —19 —60 —60 —37 
bnormals (22) F 100 sg y w â S -13 —-63 —58 —38 


low 7 j Iso the conclusions to be drawn 
s found for Pa, Mf, and D. The first These are also tX i $ 
five clinical scales betad above are those from the 1's of Set T with the K-corrected 
Which are corrected by K. In view of the 7’s A ’s of K with uncorrected scales 
ial Hy, it would appear that a correction mee ose in Table 2. The 7’s of Set 
it ; ‘ id on with unc 
eee, ae will be sgio the 7’s in Table 2. It would appear that Set T 


is later l i 
£ ii ith M nd K accomplish essentially the same thing. 
Pe bai of K and Set T with MMPI ee comnts superior to E i not aite- 


es and optimum weighting. Table 3 shows : 

E rs of Set T and K with five correcte minable from the Seas shan 
? 

seven uncorrected scales. These ‘7 ark thing in addition to what 


specially interesting. The 7’s for Set Tand set, it my do. 
` are remarkably alike for all variables (the is fo z collecting all the data involving K 
the correlations the writer suggested to cg ape | pat pe 

hould be added to a 
ave been weighted reasonably well,’ as haps AK ot a aay located in his files 
Shown by the 1 “a of K with K-corrected rather than 2K. a 18) curve for the sam- 
Pt and § sili have been the differential ratio ( Sr and be 

c; perhaps Hs and Pa e ple used to determine how muc 


‘weighted and Ma underweighted with K. 
Table 3 


Ove 


dg MMPI Scales 
Correlations of Set T and K with Five K-corrected and Seven Uncorrected ^ 
MMPI Scale 
Pi Sc Ma : 
Pd K +.2K Si 
Hs $ pa +1.0K +10. 
Suppressor Sample Sex N D £ 4.5K D Hy +45 Mf +° 
Sı 02 32 25 
et T College 6 02 —28 —17 20 % 02 
Freshen (7) M 209 -23 7 oe 
= 12 —31 —49 
K Pallege gat 42 03 36 26 —23 —09 05 
reshmen M 209 fii 
a 08 -23 —27 
K Ninth g a so 8 27 —05 —14 11 
graders (13) M 200 = 
ia = —07 -25 -52 
K Ninth j 2th 22 07 32 u o3 —08 01 0 


graders (13) F 200 
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added to Ma. This curve showed the validity 
of Ma plus K increased rapidly to .2K, re- 
mained at this level until .5K, then decreased. 
Hathaway recalled that .2K was selected to 
avoid adding additional error variance. This 
writer believes in view of the data collected 
to date that the addition of .4K or .5K would 
improve the validity of Ma. As mentioned 
above the 7’s of Set T and K with Hs and 
Pd in Table 3 are offered as evidence that too 
much K has been added to Hs and Pd. Ad- 
ditional evidence that the Pd scale may be 
overcorrected is found in a reanalysis of Cap- 
well’s data (3). McKinley, Hathaway, and 
Meehl (18) reported the K-corrected Pd scale 
decreased the differentiation of Capwell’s ado- 
lescent delinquents from their matched con- 
trols. 


The MMPI: Operation of the K Scale 


The manner in which K operates to im- 
prove the validity of certain MMPI scales 
has not been described in the literature. One 
way of seeing how K works is through an 
analysis of the scored responses for each 
clinical scale. It should be obvious that focus- 
ing attention on the scored direction of re- 
sponses is not a very precise method of analy- 
sis. This approach ignores the percentage of 
clinical and normal persons responding to 
each item; one item to which a large num- 
ber of one or both groups respond in the 
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scored direction may count as much as sey 
eral items to which a.very small au 
one or both groups respond in the score! i 
rection: e.g., half the Hs items are answa 
in the plus direction by less than 15 per ; 
of the normal population. Other factors a 
as unusual wording of items may conta 
the results: e.g., many Hs items are be, 
in the negative, “I do not often ere 
ears ringing or buzzing.” The effect (o nother 
which are common to several scales F PEE 
important factor. Wheeler, Little, an ee 
(24) point out, for example, that and HY 
+ .46 can be expected between R AE r, 
because of 20 overlapping items. AAE P ahak 
most important, response set, mie conse- 
(5, 6) points out, is probably of cant 
quence when the items are unambig oa 
Direction and significance of posit men- 
sponses for uncorrected scales. Tt different 
tioned earlier that the items 
MMPI scales are scored in diffe a? 
tions. Table 4 presents the number the 
centage of scored responses as a1 ave tie 
standard score a test taker woul items were 
items were marked true, or if all a the dif- 
marked false (12). The magnitude 0f irage 
ferences in standard scores and pe hrde re 
true and false should be noted. The to right 
sponse” profile increases from Snown as 4 
and resembles what has begom > respo” 
psychotic-type profile, the “false 


Table 4 


n) 
The Number and Percentage of True-False Scored Responses and Standard Scores (for Me 
for 13 Uncorrected MMPT Variables 


MMPI Scale ue Si 
Scored response L F K Hs D Hy Pd Mf Pa Pe Se F 35 
1 35 
True 0 44 1 11 20 13 24 28 25 39 5 tt 79 
False 15 20 29 22 40 47 2 32 15 9 73 4 
Total 15 64 30 33 60 6 50 60 40 48 P 30 
78 50 
Percentage true 0 69 3 33 33 22 48 47 63 81 22 24 `o 
Percentage false 100 31 97 67 67 733 52 53 37 A 5 5 
Percentage difference —100 38 —94 =34 -—34 =5§ -4 =ó 26 6 : 
6 
T score when all 1 120 97 
marked true 50— 80+ 29 65 58 44 75 65 100 9 6l 
T score when all é 3 "9 


marked false 80+ 


OO O 


[aE 


= 


= 


p 
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Table 5 


The Numbe 
rand ome of True-False Scored Responses and Stand 
or Five K-corrected MMPI Clinical Scales celine Pree 


MMPI Scale 


Scored i H 
= red response +.5K +4K 440K tae = 
d Al 2 
False 37 38 38 46 = 
ren 37 38 38 46 z 
i 49 63 78 108 i 
Poeitage true 24 40 5 
Tee false 7 60 29 H 3 
rcentage difference —52 —20 5 i 30 
i 14 30 
T E when all marked true 52 64 8 
e when all marked false 116 95 si "96 30 
_64 —31 4 24 is 


T score difference 


Profile 
ir oles from left to right and re- 
scale t neurotic-type profile. 
seful o measure response Se 
0 eee the discrepancy i 
crepancy = is greater than, say, 40 (the dis- 
Oats), ‘el 48 per cent on Scale S of the 
Ceivably See of this discrepancy Con 
; T Boise! result in improving 4 of 10 
Ng the ie scales, The three scales hav- 
(Pt, Sc, ar ae of scored responses as tue 
g say, S Ma) could be adjusted by add- 
aving E False scores and the one scale 
could he st scored responses as false, Hy, 
adjusted by subtracting Set False 


Scor, es 
he fraction of Set False to be added 
scale can 


bed earlier 


t is likely to 


be 
u 
n percentage 


? or 
Pa he: racted from the clinical 
Set T ined empirically as descri 
OF cou of the OAIS. 
a then since only the scored 
= Onse seh into account, & meas 
tpidity of will not necessarily improve the 
Ve or p these scales. A correlation, posi- 
F ape between Set False and a 
mie soni probably indicates that Set 
ae © (or Al used as a suppresso". If Set 
rely lated or that matter @”y variable) is 
pated to to the clinical behavior, but 15 
alse m the MMPI clinical scale, then Set 
thy be used as a suppressor even 
Set 3 18 see is no true-false imbalance- 
8p in plac cepted as the measure of response 
tnt pe OL Ser False, to add false 1° 
© Pt, Sc, and Ma, and subtract false 


direction is 
ure of re- 


a O 
Clinica 


thou 
I gh 


responses from Hy, the validit; 

clinical scales would be h ES 
recalled (Tables 2 and 3) that the r’s for the 
uncorrected clinical scales with K were larg- 
est for Pt, Sc, Ma, and Hy. Š 


Interpretation of K scale. Meehl and Hath- 


away (22) reported that r’s between K and a 


clinical scale “as low as .20 can be utilized 
to yield very significant and useful improve- 
ments in discrimination.” The validity of Pt 
Sc, and Ma was improved by the addition of 
Kora fraction of K (18). It appears (18, 


22) that attempts were made to add K to 
uld attempt addition of K 
and Hy follows from the commonly held view 
_ McKinley, Hathaway, and 


resent the defens: 
test attitude continuum, 


proach to the problem is 
fraction of K ) to the raw score on each per- 


sonality variable, i.e, increase the score in the 
direction © abnormality.” They apparently 
felt the K correction for Hy resulted in no im- 
provement pecause the Hy scale contained 
10 of the 30 K items which were scored in 
the same direction. If K is viewed as a meas- 

then K or some fraction 


ure of response set, 
of it should be subtracted from Hy. That is, 


a person with a high K has probably earned 
a higher HY than he should have. To say that 
he has “faked pad” is debatable. If K is not 
an adequate measure of response set, then 


the most obvious ap- 
to add K (or some 
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false responses from a scale such as Set F 
could be subtracted from Hy, or true responses 
from a Set T scale could be added to Hy. 

Direction and significance of scored re- 
sponses for K-corrected scales. Table 5 shows 
data similar to those found in Table 4 except 
that the A-corrected scales are described. On 
the basis of the number of true and false 
scored responses in Table 5 the 7’s for Set T 
and K with the K-corrected scales in Table 3 
are to be expected: e.g., the r between K and 
Hs + .5K is positive, the r between K and 
Ma + .2K is negative, and the r between K 
and Pt + 1.0K is about zero. 

For all K-corrected scales in Table 3 the 
7’s with K are consistently less negative (some 
are positive) than the comparable r’s in Table 
2. From Tables 4 and 5 it can be seen that 
these changes in r are accompanied by a con- 
sistent increase in the proportion of false re- 
sponses in the clinical scales. However the r’s 
of Tables 2 and 3 indicate that the true-false 
imbalance shown in Tables 4 and 5 will not 
explain all the 7’s obtained for the suppres- 
sors K and Set T with the clinical scales: 
e.g., uncorrected Hs correlates negatively with 
K despite the fact that 67 per cent of the 33 
Hs items are scored false; Si correlates posi- 
tively with Set T and negatively with K de- 
spite the fact that 50 per cent of the Si items 
are scored false. Several possible explanations 
for these unexpected correlations have been 
mentioned. Perhaps the important point here 
is that a measure of response set such as K 
or Set T may function as a suppressor when 
there is no true-false imbalance, and may not 
function as a suppressor when there is a 
moderate true-false imbalance. 

Correlations of K with other MMPI scales, 
Of considerable interest is the relation of K 
to several nonclinical scales which were con- 
structed for the MMPI and reported by 
Meehl and Hathaway (22). K was found to 
correlate — .70 with N, a scale derived em- 
pirically by Meehl (20) to correct for self- 
criticality of certain normal plus-getters who 
show deviant profiles. As would be expected, 
the majority (50 of 78) of the items are 
scored true. The v of K with G and + (plus) 
was — .76 and — .64, respectively; both these 
scales were derived wholly by a method of 
internal consistency and without regard to 
nontest behavior. Only 9 of 62 items in G, 
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7 
and 11 of 55 items in + are scored i 
The r of K with Cn, the correction baa 
the old hypochondriasis scale oo 
— .67; Cy was derived from an item eR: 
of the responses of the original 50 Lae 
driacal criterion cases and 50 na o 
driacal psychiatric patients who score scar 
H. Of the 48 items in Cir only 13 are & 
false. The r of K with Hy-O was 2? 


analysis of a correlation matrix of 
cial scales revealed “one comm ay 
quite sufficient to account for oe saa 
lations of these scales.” /¢ may q that 
common factor is response set, eel in 
best measure of it might be obta! 
manner described for Set 7. 


it. 
Some Implications for Personality 
Test Research z 


est De 
Studies need to be done on the nom pons 
havior of those with a strong or w al ternative 
set to mark a particular response ensured i 
The determination as to what 15 z mad? 
scales such as Set T and K as fo th 
in this way. Too frequently wn scores i 
K scale have been correlated et peen mh 
other tests, and judgments hav ‘ag. alidi 
as to what K was really measar 5 
indicators such as L and F oe imbal 
posed of items without a true- ps obtain’ is 
so that independent measures AeA a B 
In view of the ease with W ee ; v 
Set T-type scale can be e se s 
writer recommends that zepo iy validat, 
be prepared for other empii a jth 
personality tests; scales ie Pit seems “19 
sponse set should be corrected. id be able e J 
likely that response set keys git da 
bring validity to tests which are = we may ft 
empirically even though respons er’s score s 
a major component in a test r. awe 2 d 
is important that those who Pts j 
empirically validated personality ao 


j] for nce 

7 The writer obtained the scoring a jnfet? 
+ from Dr. S. R. Hathaway to che ik F 
that most of the items were scored os item H5 

8 The construction of the present tare; it 
has not been described in the litera 
of 31 items taken from the 55 ite’ 
items which were not in the 0 
(A-Cx) scale. 
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Response Set as a Suppressor Variable 


cerned not only with the degree to which an 
item discriminates between criterion groups 
but also with the direction of the scored re- 
sponses, A recent review by Furst and Fricke 
(10) discloses that rarely does a scale con- 
pee indicate the direction of the scored 
oe nses. The correlations between many 
i s and tests can be “explained,” at Tenet 
A by an inspection of the scored re- 
Spo ses and recognition of the role that re- 
nse set may have played. 


Summary 


tse, method for constructing a scale to meas- 
alit a test taker’s set to say “true” to person- 
Sona mal items was described. The Set T 
Pe. the Opinion, Attitude, and Interest 
Spon, y (OAIS) was used to show how re- 
a ms set could be harnessed to function as 
lidi pressor variable and improve the va- 
dictor of two empirically validated grade-pre- 
Scales. 

e marked structural and functional simi- 
Mp of Set T of the OAIS and K of the 
itio 5 was drawn upon to challenge the tra- 
evider al interpretation of the K scale. Some 
Som nce was assembled which indicates that 
x © Of the MMPI scales are not optimally 

“Corrected. 

t t was suggested that those who construct 
With th personality tests should be concerne 
Well $ direction of the scored resp i 
cri as with the degree to which an item dis- 

™Minates, 


larit 
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Two Measures of Anxiety’ 


Erwin J. Lotsof and Walter L. Downing 


University of California, Los Angeles 


The chronic anxiety syndrome, as defined 
by Cameron, is “characterized by the pres- 
ence of persistently heightened skeletal and 
visceral tensions . . .” (2, p. 249). Using this 
definition, Taylor (5) devised a paper-and- 
pencil test to measure manifest anxiety. 
Mowrer (4) and Bixenstein (1) use the term 
tension in the therapeutic situation in a way 
which appears to be synonymous with anx- 
iety. They measure changes in tension by re- 
cording palmar perspiration, and by comput- 
ing a Discomfort-Relief Quotient. In view of 
the apparent similarity of these two concepts, 
anxiety and tension, it was felt that the two 
measures, if applied to the same population, 
should show a substantial correlation. 

The Taylor Scale of Manifest Anxiety 
(TS) was administered to an introductory 
psychology class. A week later, 30 of the stu- 
dents participated in another “experiment” 
in which palmar perspiration (PP) was re- 
corded by the method described in Mowrer 
(4). No indication was given the participants 
that the two measures were related, nor that 
they concerned anxiety. Two judges ranked 
the fingerprints for density in an almost 
identical sequence (rho = .99). The range of 
TS scores was 1 to 26, with a mean of 10.23, 
and an SD of 6.33. The TS scores were 
ranked, and the two measures gave a rank- 
order correlation of 0.00. 


1 An extended report of this study may be ob- 
tained without charge from Erwin J. Lotsof, Dept. 
of Psychology, University of California, Los An- 
geles 24, Calif., or for a fee from the American Docu- 
mentation Institute. Order Document No. 4827 from 
the ADI Auxiliary Publications Project, Photodupli- 
cation Service, Library of Congress, Washington 25, 
D. C., remitting in advance $1.25 for microfilm or 
$1.25 for photocopies. Make checks payable to Chief, 
Photoduplication Service, Library of Congress. 
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ship existed between the variables t 
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ing” the entire personality, E ië total Ol 


conceived of as a response 0 


3 t to ex” 
ganism, then the results are difficul 


i 5 
plain. «7 measu? 
Assuming that the tests are gelio m o bY 
of manifest anxiety and of — or the 
potheses might be offered to accou! = jnter 
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Social Desirability in the MMPI’ 


Wilbert E. Fordyce 


Veterans Administration Hospital, Se 


The 
atter, SD) bos of social desirability (here- 
IM several st T been explored and elaborated 
concerns el Males: (1, 2, 3, 4, 6). The concept 
Controllin ucidating a basis for describing and 
ality fois test-taking attitudes on person- 
efinition j ones and schedules. A preliminary 
ehavior z Consensus judgments as to what 
approval. i eelings, and attitudes win social 
ional spe n American society.” A more opera- 

pecification will be given below. 


Thei Problem 
rom aa on for studying S-D stems largely 
found i by Edwards (1) in which he 
ality iny, quency of endorsement of person- 
relateq apay items as self-descriptive cot- 
Values of with the rated social-desirability 
construct the items. Edwards proceeded to 
sran ae Personal Preference Schedule 

to n urra, Jective-type personality test, based 
9 R ae system, in such a way as 
8S social] Sen test-taking attitude of endors- 
he lea esirable items. The construction 

Y the st nrole; the assumption, supporte 
Of the al ies cited above, that 2 major part 
Counted “ye in these types of tests is ac- 
Sctibe to or by the test taker’s desire to sub- 
Our io that are desirable in 
an y. The present study concerns itself 

e ata of this concept of S-D to 
entor nesota Multiphasic Personality In- 
"y (MMPI) (5). 
(F i ase validity scales of the MMPI 
8 ig ws attempt to characterize the ` 
o aa the test and his readiness 
Criptive , e to items in the clinical scales de- 
etween a mental illness. The relationships 
tp, ese validity scales and the clinical 
Washington, and 1 Administration Hospital, Seattle, 
Y of Was and Department of Psychiatry» ver- 
ashington School of Medicine. 


Ject? 


attle, Washington 


scales are formalized in the instance of K b 
applying & correction to five of the clinical 
scales based on the K score. With the general 
notion that the subject’s approach to the test 
can be substantially characterized by his 
readiness to respond to socially desirable or 
socially undesirable items, and that this ap- 
proach is reflected in both the validity = 
clinical scales of the MMPI, the hypotheses 
for this study are: 


a. There will be a significant correlation be- 


tween an S-D scale and the F and K ® scales 


of the MMPI. 
ll be a significant correlation 


b. There wi 
between an S-D scale and the clinical scales 


of the MMPI. 

Method 
of S-D used in this study de- 
t. A subset of MMPI items 
ing of those making up the F, K, and 
siety (7) scales was presented to a 


dges. The judges ranged from 
departmental secre- 


Washington De- 
were asked 


The measure 


he University of 
partment of Psycholog 

to select the items, an i 
scoring, whic 
sponses when 

those items on which all 10 judges agreed as 


u 
his criterion. 
f these 
in the appropriate direction. 


sisted of all the available, com- 


pleted, group-form MMPI records on male 


2 Edwards (3) has already 
of .63 between S-D and 
Je was construc 


3 The sca 
University of Washington. 


reported a correlation 


ted by Allen L. Edwards, 
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Table 1 
Item Overlap Between S-D Scale and Other MMPI Scales 


MMPI Scale 


Ma 
No. of items L F K Hs D Hy Pd Mf Pa PL Sc ; 
4 
No. in MMPI Scale 15 6 30 33 60 60 50 60 40 e . 3 
Scored same in S-D 0 0 5 2 1 2 0 0 i 2 
Scored opposite in S-D 0 48 1 9 7 4 0 11 


psychiatric and/or neurological patients in 
the VA Hospital, Seattle. Only the first 
MMPI record obtained in this hospital was 
used. Records with more than 25 items 
omitted were excluded. There were 97 rec- 
ords meeting these criteria. Since testing oc- 
curs on a consultation basis, this sample is 
not a random representation of the neuropsy- 
chiatric population in this hospital. However, 
except for the exclusion of patients too hy- 
peractive, confused, or with motor disabili- 
ties prohibiting handling the test, the sample 
would appear to be reasonably representative 
of hospitalized male veteran psychiatric and/ 
or neurological patients. 


Results and Discussion 


Since both hypotheses involve the degree 
of correspondence between the S-D scale and 


the regular MMPI scales, the question of in- 
fluence of ite 


This issue is 


MMPI scales. 


It seems-evident from inspection of Table 1 
that item overlap is not sufficient to establish 
substantial correlations between S-p and the 
validity and clinical MMPT scales, except for 
F. In that instance the 75 per cent 
would assure a substantial Correlation þe- 
tween the two only as long as the direction 
of scoring of the overlapping items was con- 
sistent. The fact that all 48 F items Occirring 
in S:D are scored in a single. ditection on 


Overlap 


S-D, by unanimous judgment of 10 judges, is 


itself indicative of a correlation of F mie 
S-D. In order to be able to evaluate et 
rately the effects of S-D and F, thig aie in 
lap between the two scales was ree sepa- 
a subscale of S-D, by scoring all records to F. 
rately for the 31 S-D items not re 
This subscale is designated as, S-D- on S-P 
Table 2 gives the correlations betwee scales 
and S-D-F and the clinical and velia an 
of the MMPI, and between F and able 2 
these scales for the 97 test records. rrela- 
indicates S-D has a highly significant ‘onfirm 
tion with both F, — .82, and K, .69, hat S- 
ing the first hypothesis. The fact = scales 
correlates higher with each of ae seems 
than they do with each other (—- unde!” 
to indicate at least one common far er esti- 
lies F, K, and S-D, and that S-D bet either 
mates this common factor than does 


Table 2 


ith Cli 
Correlation of S-D and Validity Scales ets 
and Validity Scales, Without K Cor 


nical 


Comparison Scales 


MMPI K 

Scales S-D S-D-F r 0" 
L 24" a 10 g5" 
F —8I** —60** 
K on VA ai —55*" oo" 
Hs —70**  —49** Sia 
D sgo qoe SOT Zia 
Hy —38**  —47** 25° AL 
Pd —57** —33** 56 Š BEA 
mf -21 33%" 35 Dag 
Pa =E A D 
Pt —86**  —65** ol 
Se -91 o2 BH 508 
Ma —som* 30" AFF 49 
Mean} —651** —498** 566" 


vel. 

* Significant departure from zero at 5% level 

Significant departure from zero at 1% level. 
Nine clinical scales only, 
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MMPI Scales 


Hy Pa Mf Pa PE Se Mo 


50 


———--Wheeler Psychotic Factor 


. 000 a Signs reversed on F and 
Wheeler factor 


-50 


“100 


“150 


72.00 


Jer presented no 
= id schotic factor, S-D, F, and K. Note that Whee! 
CETNA P ading of his factor on Hy. 
ini : high, it seems evident 
clinical scales’ are so y 
pon ts the factor is well reflected in several of the 
hen the decid in Seance 


F 
ie) 
Sppe The correlation of — 60 


R @d F clearly indicates that w 5 join 
at are ope yon S-D there is still = oe ple MMPI records to 
y sieni ; ip. of one : arent underlying 
Tela : eet eee at 2 will cor- investigate further this aPP 
© significa ith t Jinical scales js factor. using @ sample of 112 
nificantly with the c! i Wheeler, of al. (8); W psychiatric patients, 


0 á 

Se nd 5 titinted by the correlations p male veteran hospitalized Ps 
: In Ta orrelation be- ran 

tween able 2. The mean © intercorrelated and facto in two factors 


Si S-D and i Jinical scales of his resulte! 

M $81 is ver a a onean: Only the MMPI records i Neurotic. For the pur- 

nil Scale has 4 zorrelajion which is not sig- labeled, Peyer SA only the first Wheeler fac- 
cant, 3 _p-F with poses © this stuc is Psychotic factor 

i Sister mean pe = a highly tor will be considered. TPI eo fils: 80> 

ign; scales of — 498 } was characterized marked degree in an indi- 


thing pa again indicating that sobi a Dr 
5 F Sim the F eK ‘ce -D-F at “qual, the usual €60-C8 a the person now 
tee of ial tests | in Table 2, 
saan S a tight GP zn] undesirability. Tf that is 
nr an mone oars Eee 
fa . This Jen er support stent UEan S gyuRaseateen the S-D scale ‘aor 
Won that thee ie an underlying fOO POE. cya I ronal ws tios, it be 
tiong 4, those three scales. since the aA the were optained by ofthogons rotations, 


etween these three scal 
Acs No. 
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comes feasible to treat his factor loadings 
as correlations, permitting direct comparison 
with the correlations presented in Table 2. 
In order to correct for the skewed distribu- 
tion of 7 and pull apart the distributions of 
F, K, S-D, and the Psychotic factor on the 
higher correlations, these data are presented 
as 2” transformations of the original correla- 
tions. They are presented in Figure 1 in 
graphic form, with the signs of F and the 
Psychotic factor changed to negative to make 
visual comparison easier. 

The striking thing about Figure 1 is the 
remarkable similarity in shape of the four 
distributions, F, K, S-D, and the Psychotic 
factor. It seems evident that each of the four 
is well saturated with some common com- 
ponent. It will be noted from Figure 1 that 
S-D more closely approximates the shape and 
elevation combined of Wheeler’s factor than 
does either F or K. This greater conformity 
of S-D is indicated by the sum of the squares 
of the differences of 2’ values between each of 
S-D, F, and K with the Psychotic factor 
across the nine clinical scales. This crude 
measure of conformity yielded values of 1.53 
for K, 1.03 for F, and .52 for S-D. The 
smaller value for S-D clearly indicates less 
discrepancy between the 2’ values of S-D and 
Wheeler’s factor than for either F or K . This 
correspondence is some joint function of shape 
and elevation. The greatest gap between S-D 
and F and K in relation to the Psychotic fac- 
tor is on the Psychotic scales of Pa, Pt, and 
Sc. Thus, S-D better represents the factor 
than either F or K where the factor plays its 
biggest role. 

These findings would seem to indicate that 
much of the approach to the MMPI which F 
and K attempt to characterize can better be 
accounted for by a single factor. This under- 
lying factor is better estimated by the S-D 
scale than by either F or K, Such an inter- 
pretation is in line with the general findings of 
the studies cited above in which it has been 
noted that most of the variance on objective- 
type personality tests can be accounted for in 
terms of social desirability. 

The obvious heavy saturation of several of 
the clinical scales with what Wheeler terms a 

Psychotic factor but which here would seem 
to be as well labeled as social-wndesirability, 


Wilbert E. Fordyce 


suggests that mental illness, in a generale 
sense of the term, may be characterize d 
involving behavior which is socially E 
proved. This is indicated over a oe! P 
range of symptom-descriptive items, n R 
ticularly on the psychotic scales of Pa, 
and Sc. 


Summary 


A scale of social desirability ag 
constructed from the MMPI, based a hy- 
mous judgments of 10 judges. It rorrelate 
pothesized that this S-D scale ioe ea scales 
significantly with the F and K validi Y jinical 
of the MMPI and also with the nine €l 
scales. Both hypotheses were ae: and 

The S-D scale correlated highly T n they 
K and higher with each of them t a com- 
do with each other. This suggests HR S 
mon factor underlies the three and t as con- 
is a better estimate of this factor. It W rd the 
cluded that test-taking attitudes ee or 
MMPI can be characterized as epee desit- 
lack of readiness to respond to socially 
able items. . 

The S-D scale had a very highly 
cant average correlation with the sar 
scales. The correlations were genera! A to 
but the pattern very similar in shap clinical 
pattern between F and K and the serlying 
scales, again implying a common para one 
factor. Findings from a factor ana i 
elsewhere were compared with the Pë dis- 
this study. It was demonstrated a al scales 
tribution of loadings among the dn to 
of a Psychotic factor was quite simi a 
correlation profile with the clinical “mate 0 
S-D, F, and K. S-D was a better ee D 
this Psychotic factor than either F © unde” 
was concluded that a common fact jculay 
lies many of the clinical scales, pat charac” 
Pa, Pt, and Sc, and that it may be 
terized as social desirability. 

The findings of this study suppoT 
dence from other studies cited that lity 7 
the variance of objective-type persona of # 
ventories can be accounted for in to nding’ 
dimension of social desirability. T he .n0¥® 
also appear to reflect society’s iness f 
negative attitudes toward mental be avio" 
labeling it as socially undesirable 


signif- 

clinic 

higher 
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t the a 
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The Effect of Manifest Anxiety on a Concept | 
Formation Task, a Nondirected Learning Task, | 


Aron W. Siegman 


Veterans Administration Hospital, Bronx, N. YA 
and Teachers College, Columbia University 


and on Timed and Untimed Intelligence ‘Tests | 
| 


Incidental to a validational study of the 
Taylor personality scale of manifest anxiety 
(MAS) (9), data were obtained about the 
following manifest anxiety correlates which 
have been discussed in the literature. 

1. Goldstein has stated that anxiety inter- 
feres with abstract thinking (1). A recent 
study by Wesley (12) failed to support this 
hypothesis. However, the author as well as 
reviewers (6) have pointed out that the re- 
sults of her study are by no means conclusive. 

2. Recent research Suggests that stress and 
anxiety interfere with nondirected or inci- 
dental learning (10, 11). 

3. A number of investigations indicate that 
me pressure has a greater disruptive effect 
on anxious than on nonanxious Ss (2, 8). 


ti 


Procedure 


Thirty-five male medical and psychiatric 
patients were administered the Taylor MAS 
(7), the Wechsler Adult Intelligence Scale 


(WAIS), Raven’s Progressive Matrices (PM), 
the Bender G ecall 


Test (5). All 
Psychotic or sus- 
damage. 


he effect of mani- 
n, Ss’ MAS scores 


pected of having cortical 
In order to determine t 
fest anxiety on abstractio 


1From the Clinical Psychology Section of the 
Neuropsychiatric Service at the Veterans Adminis- 
tration Hospital, Bronx, N. Y, The author wishes 
to express his appreciation to Dr, H T Flowers 
Chief of Neuropsychiatry, for his interest and sup- 
port and to Dr. R. S. Morrow, Chief Clinical Psy- 
chologist, and Dr. Julia C. Hall, Assistant Chief 
Clinical Psychologist in charge of research, for their 
encouragement and help. 


n 
which involves the eduction of patterns # 
relations. MET 

As a test of nondirected learning Teat 
phase of the BG was used. In the ability | 
phase, usually perceived as a drawing designs» : 
test, Ss were instructed to copy nine Follow 
which were presented one at a ae 
ing this phase of the test, Ss were could 12° 
reproduce as many designs as they ses 
call. For experimental control Oe of 39 | 
same test was administered to a as e 
similar Ss, with directions to mem 
designs as they were copying Ta 
they would be asked to recall t ae 
spent on the learning phase was the 4 
the two groups. The MAS Sano 0 
groups were correlated with their ; 
the Recall Test. , he effect a 
Finally, in order to determine the €’ -< gs, 


. i on PM, | 
were correlated with their scores l 
LY 


, Recall 
ning 


us 
time pressure on anxious and are ime 
the WAIS was divided into two parts: | pic 
limited subtests (arithmetic, digit i 
ture completion, picture nage | subtest? 
design, and object assembly) and ing $ i j 
with no time limit (all the remaini”®, hes 


i 
i 

tests). The performance of the i e 5 

Taylor scorers (35 and higher) an ) on hes 
lowest Taylor scorers (15 and less 
two sets of subtests were compared. | 
Results es and f 

The correlation between MAS ford df? 

PM scores was r = — .41, which ce Jeve! y 
significant beyond the .01 confiden cor 


: t i 
For the nondirected learning gtouP G peca! 
relation between MAS scores and 
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ae 


The Effect of Manjet Artery On Suae 


Mean Sı sh 
cores on Timed and Untimed WAIS 
Subtests in Relation 
to Taylor MAS Scores 
M 

Group med mi 
High Tayl H = = a 

a 
ee echoed 10 10.10 1.81 = = 

ae i 1010 FE ma 215 2:51" 
f 2.03 1.24 


* Simni 
Signific: 
IFR cant at the .05 co! evi 
her's ¢ for correlated nee ete 


Test sc 

cant los r= — 44, which is signifi- 
ever, for th the .01 confidence level. How- 
Correlation £ directed learning group the 
Significant] a U which is clearly not 

Finall y different from zero. 

high na ne 1 indicates that only the 
scores on scorers had significantly lower 
cq, the teeta subtests of the 


Discussion 


The 
tai on of this study seem self-ex- 
the finding However, the difference between 
Wesley (i of the present study and those of 
the My invites discussion. Whereas in 
tween MAS study a negative correlation be- 
tained, į scores and PM scores was ob- 
Scorerg x ra Wesley study the high MAS 
cantly bett consistently though not signifi- 
rab (wes on the Wisconsin Card Sorting 
hat anxi T), also a test of abstraction. 
= domme ee not always a disruptive force 
8 and f y in some cases may be a motivat- 
ut by hee force, has been point 
oe 34) Mosophers and psychologists (3, PP- 
®ads to th This differential effect of anxiety 
: when obvious but very important ques- 
Tee, and does anxiety act as a disruptive 
facili when does it act as & 
‘acilitating factor? One possible reply is 


motivating 


tion 

o 

tha 

at j 

ta T on the degree of anxiety. p 

28 fore ain point anxiety may be a facilitat- 

‘ety Aa , but beyond this optimum point anx- 

Probab] omes a disruptive forc Tt is quite 

ep le that the Ss of the present study, 
more than 


the opti 
in P aum level of anxiety- 
Teinfore esley study the correc 
M the a no such reinforcement t ) 
rar Lack of reinforcement, especially 
ask which was part of 2 diagnostic 


evaluation, may have in z i 
begone the, optimum fo sae oe Se 
ecent research suggests th 

anxiety upon oe pede 
difficulty of the task involved or ae 4 
cisely, upon the initial relative iste ‘of 
correct and incorrect response tendencies in 
the situations (4, 12). Thus the difference be 
tween Wesley’s and the present findings a 
be due to the fact that the WCST is a E 
simpler task than the PM, and therefore less 
subject to disruption by anxiety. Moreover 
the facilitating effect of anxiety in the WCST 
may be due to the fact that during the learn- 
ing phase of the WCST the correct response 
is reinforced which increases the relative 
strength of the correct response. 

Preliminary research suggests that motiva- 
tion to do well is another important variable 
in determining whether anxiety will act as a 
facilitating force. The hospital 


14 high Taylor MAS scorers 


(35 and higher) W. standard score 


on anxiety-sensitive tasks (arithmetic, digit 
i ign, and object 


BG Recall Test and 


below their average score on 
subtests of the WATIS. How- 
tal files also contained 9 high 
Taylor scorers wh age standard score 

tasks was above their 


on the anxiety-sensitive 
average standard score 0n the tasks not sensi- 


tive to anxiety. An investigation of the be- 
havioral descriptions in the psychological re- 
ports abou groups of Ss revealed 
that whereas 4 jori the good perform- 
anxiety-sensitive tasks were de- 
tive, well motivated, and 
ority of the poor 
itive tasks were 
ivated, and 


inter 


performers 
described as apathetic, poorly mot 
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Table 2 


Test Performance of High Taylor MAS Scorers in 
Relation to Motivation 


Superior Inferior 
performance performance 

Motivation as reported on anxiety on anxiety 

in diagnostic report tests tests 
Cooperative, interested, 

well motivated 6 1 
Reluctant, poorly moti- 

vated, apathetic 0 10 
No description of Ss’ 

motivation 3 3 


Note.—The chi-square value of the distribution in this table 
is 13.10, which for 2 df is significant beyond the .01 confidence 


reluctant to take the tests. Table 2 gives a 
more detailed analysis of the behavioral de- 
scriptions of the two groups. These results 
suggest that one’s need and desire to achieve 
is an important variable in determining 
whether anxiety is going to have a disruptive 
or a facilitating effect. Thus the difference 
between Wesley’s and the Present findings 
may be due to the fact that the Wesley popu- 
lation consisted of college students who prob- 
ably were much more motivated to do well 
on a concept-formation task than was the 
population of the present study, and there- 
fore anxiety did not act as a disruptive force. 


Summary 


_ Thirty-five Psychiatric a 
tients were administered t 


S Was adminis- 
» the BG, with instruc- 
ns, and the BG Recall 


The correlation between 
scores on the PM was r = 
directed learning group t 
tween MAS scores and sco 
call Test was r = — 44, þ 
learning group the correl 


MAS scores and 
— 41. In the non- 
he correlation be- 
Tes on the BG Re. 
ut in the directed- 
ation was r= .07. 


10. 


de ° 
11. Silverman, R. E. Anxiety and the mo 24, 


12. 


Siegman 


Finally, Ss who received high scores on a 
MAS obtained significantly lower scores ie 
the timed than on the untimed subtests of 
WAIS. : 

These findings suggest that anaiety Han 
disruptive effect on abstraction, incide 
learning, and timed intelligence tests. m 

It was suggested that the nature aie | 
task, the degree of anxiety, and motiva emt 
factors are important variables in deter A 
ing whether or not anxiety will have 4 
ruptive effect. 
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The I 
n 
“se fluence of Ego-Involvement on Relations 
ween Authoritarianism and Intolerance 
of Ambiguity’ 
Anthony Davids 


Brown University and Bradley Home 


After 

ously ere failure to replicate previ- 
ism and rigidi findings between ethnocentric- 
at a rn (19), Brown (3) discovered 
Tesearch w variable to be considered in this 
Subjects (Se) the condition under which the 
When the a were assessed. He found that 
Scale es Par administered the California 
ems in a fri the Einstellung arithmetic prob- 
there was ape casual, relaxed atmosphere 
ism and SA relation between authoritarian- 
Were wine However, when the Ss 
ormal pion these same measures under 
“dito ee threatening, ego-involved 
Ociation toe was a significant positive as- 
em-solyin etween authoritarianism and prob- 
findings $ rigidity. On the basis of these 
ational rown concluded, “An adequate 0P- 
definition of this rigidity must in- 
ving 


Clud e 
th S 
le the establishment of an ego-invo 
e of 


n, 
dity pe ear The ‘same’ measur 
re Sie i ge in a relaxed testing atmos- 
© authori uces scores which are not related 
na itarianism” (3, p- 415). 
finding N paper, Davids (6) reported 
o relation between authoritarianism 


1 Thi 
is g 
tudy was carried out at the Harvard Psy- 


Chologs 
Lan Bical Clini 

Clinic, It was supported in part by the 
d in part by grant 


f Mental Health, 


rigi 


Orator: 

A 0 ena Social Relations an 
blic the National Institute © 

ia iie ey Service. 
oe (ethn, e F scale (authoritarian 
the ee have been sh 
Fee are frequently used interchangeab! 
often generalized 


r 
op SeA 
f àlso, the concepts “rigidity” and 
changeably (11, 


ism) and the E 
own to correlate 
y anı 


1 igui 

3 3 aa hee have been used inter 

dip ®S. In oth have been applied to igh authori- 
the present report we will not attempt to 


renti 
iate between these concepts- 


and intolerance of ambig i s 
tory stimuli. Since the Si beat = 
volunteers participating in a ea 
search project, were examined under e nf 
tionally comfortable, nonthreatening pea 
tions, and were guaranteed anonymity. it 
seems possible that the negative findings 
might be attributable to the assessment sec 
ditions. The present experiment is an attempt 
to discover if a highly ego-involving ane 
phere will lead to significant relations between 
authoritarianism and ambiguity tolerance. 
Specifically, there are two main purposes in 
this investigation: one is to see if the previ- 
ously reported positive findings (6) of signifi- 
cant relations between authoritarianism and 
maladjustment can be replicated; the other 
is to see if the negative findings in regard to 
relations between authoritarianism and in- 
tolerance of ambiguity will be found when the 
Ss are highly ego-involved in the experimental 
tasks. In view of the import of authoritarian 
personality theory (1) and the controversial 
findings that have been reported by investiga- 
tors who have worked with this theory (3, 4, 
6, 9, 14; 17), the attempt to replicate previ- 
ous studies and to clarify the contradictory 
empirical evidence seems particularly war- 


ranted. 
Method 


Subjects 
e undergraduates were sè- 


Twenty-two mal 
cured from & college employment office. They 
were well-matched with the 20 Ss used in the 


previous study (6) in regard to such vari- 
ables as socioeconomic background, religion, 
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academic performance, and extracurricular ac- 
tivities. They differed from the previous group 
of Ss in that none of them were psychology 
majors, they had not volunteered to take psy- 
chological tests, and all were registered at the 
employment office as seeking employment. 


Experimental Treatment 


A staff psychologist contacted the student 
employment office and said that he would like 
to interview approximately 20 students in or- 
der to select a few research assistants. Indi- 
vidual appointments were arranged, and the 
psychologist conducted a personal interview 
with each prospective employee. The inter- 
view took place in the psychologist’s office 
and a formal, serious attitude was maintained 
throughout the interview. An attempt was 
made to uncover basic information about the 
person, as well as getting him ego-involved in 
the assessment procedure. Each S was told 
that we planned to hire one or two students 
to assist us with psychological research proj- 
ects and that the persons selected for the po- 
sitions would be paid at a considerably higher 
tate than the usual student pay scale. After 
indicating strong interest in securing the po- 
sition, as all of the 22 Ss did, the S was told 
that a battery of psychological tests would be 
administered and that our selection would be 
based on the test results, Thus, it is evident 
that these individuals took the experimental 
measures under conditions that were far from 
relaxed. They needed work, a good job de- 
pended upon their test performance, and the 
tests were administered in a very formal, com- 
petitive, business-like atmosphere. It seems 
justified to conclude that these men were 
highly ego-involved in the task at hand. Fol- 
lowing completion of the test battery, the Ss 
were paid for their time, and shortly there- 
after each person was sent a Personal letter 
informing him that owing to failure of a re- 
search grant to come through we would be 
unable to add any assistants to our staff, 


Measures 


Authoritarianism. The Ss were adminis- 
tered the standard 30-item F scale (1). Total 
scores ranged from a low of 63 to a high of 
122, and the mean score per item was 3.14, 
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Ego structure. On the basis of the pense 
interviews, the clinical psychologist ran Jed: 
dered the Ss on “ego structure.” A detai a 
definition of this concept has been perri 
by Murray and Kluckhohn (18) who Ea 
cate that good ego structure is highly ane 
lated with good personal and social ee 
ment. In the present study, the psycho ee 
did not have a great deal of sce a 
which to base his evaluations, and it a 
be recognized that there is zgnsiderable sy- 
for error in this ranking. However, bee 
chologist knew that he would have Di d to 
order the Ss on this dimension and trie tie 
secure information and clinical ae oie 
that he deemed pertinent to an evalua H in- 
ego structure. At the completion OF tingn 
terview, he made notes and assigne rating 
on several personality variables and materia 
on ego structure. He then used this dements 
to assist him in making his final Ju P struc 
of the Ss’ relative standing on “ego 
ture.” mi 

Manifest anxiety. The Ss were administ® 
the Taylor scale of manifest anxiety 
Scores ranged from 1 to 29, with a ™ 
12. d- 

Psychosomatic inventory. The Ss yee a : 
ministered this inventory which a SPE): l 
to provide a measure of neuroticism scores 
High scores indicate normality and low rese! 
indicate neuroticism, Scores for the P 254. 
Ss ranged from 37 to 364, with a mean p the | 

Academic achievement. Transcripts m the. 
Ss’ academic records were secured fro 
Tegistrar’s office, and they were rank-0 These 
according to their grade-point avekaae ph a 
averages ranked from A — to D+, 
mean performance at the B — level, li 

Reactions to ambiguous visual srna ink- 
Ss were individually administered ‘once? 
blot concepts from the McReynold ifie by 
Evaluation Technique (16) as modi this 
Eriksen (8, 9). Detailed description 46), 
procedure is presented elsewhere (6, ° ng 0 f 
Briefly, the procedure consists of pointine j- 
various Rorschach concepts to the 5 Ene 50 
ing, “Could this be a —?” Half of scored 
concepts are scored plus and half are © 
minus according to Beck’s (2) fred nu ` 
tables. In the present experiment, the 


red 


ean 0 


Authoritarianism and Intolerance of Ambiguity 181 


| ber Tacks > 
a —. the a0 concepts (i.e., say- sented. Briefly, these predictions were derived 
135, NA p not be ) ranged from 11 to from the theory of authoritarian personality 
RE EA a rejection score of 23. 0 (1) and from previous experimental findings 
F Vie Ss were ambiguous auditory stimuli. (10, 11, 12, 13, 19). Specifically, it was pre- 
ih e a a ministered the Azzageddi Test, dicted that authoritarianism would be posi- 
ekina = auditory projective technique tively associated with the number of rejec- 
fion A e passages of spoken communica- tions of Rorschach concepts, manifest anxiety, 
Í able staten ing contradictory and irreconcil- and neuroticism, and would be negatively as- 
I ach 7 and ideas (6, 7). Although sociated with the number of ideas recalled on 
colerent — by itself, is meaningful and the auditory test, grade-point average, and 
mingled » When several statements are inter- ego structure. That is, we expected that Ss 
ae into a passage of speech, there 1S who score relatively high on authoritarianism 
confusion and contradiction inherent in (F scale) would be: (a) less intelligent (low 


th 

oo teagan gnene the S is confronted grade-point average), (b) more anxious and 

asked using and contradictory ideas and maladjusted (high Taylor score, low P-S In- 

Bh BON as many of the ideas as he ventory score, low rank on ego structure), 

loiras m each passage. The total number of and (c) more intolerant of ambiguity (high 
he a and statements in the test is 112. rejection of ambiguous Rorschach concepts 
o umber of items recalled by the present and low recall of ideas contained in ambiguous 

with nged from a low of 35 to a high of 70, spoken communications). 

a mean recall score of 55. After hearing, Results and Discussion 


an e 
sia ine, the eight passages which con- : ki 
sheets this test, the Ss were presented with The results presented in Table 1 indicate 
‘sonal on which they could indicate their per- that only one prediction is confirmed. There 
jens to the auditory projective test. is a significant negative correlation between 
Sime ee rating scales, they indicated the scores on the F scale and intelligence as meas- 
oe of ambiguity they perceived in the ured by academic achievement. This finding 
ion n material, and the degree of satisfac- of a negative relation between authoritarian- 
| or dissatisfaction they experienced while ism and intelligence 18 10 agreement with find- 
vious investiga- 


nup ag to cope with the demands of this ings reported in several pre 

et tee dons (1p 5% 13)» cs 

Predicti Turning to the failure to find a signif- 

| oi cant correlation between authoritarian sa and 

ees wee ge ge as Ba e Sa a oe S$ 
“taney LD the earlier study (6) where a Ce able tha! s 

' ailed discussion of the Z onale and back- were assessed does not pemita i e 


Bro x ; 
und of theoretical formulation 15 pre- 


the predicted relation. Since 


mental Measures 


| Table 1 


Rank-Order Intercorrelationy, Among Experi 


Manifest P-S 


F scale 23 
= 22 
* ean structure us a 
Ollege grades 
j ~—67** 


A 

uditory test 

Rorschach test 

anifest anxiety 

| test. 


* Signi „tailed 
ignificant at the .05 level for a one taile d te: 


Significant at the .01 level for 4 
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the test results would be used for psychologi- 
cal screening, they undoubtedly distorted their 
responses to the questionnaires designed to 
measure anxiety and neuroticism. Statistical 
test of the differences between the Taylor 
scale and P-S Inventory scores of the present 
Ss and the scores obtained by the research Ss 
in the previous study show that on both 
measures the mean scores in the present ex- 
periment indicate significantly (p = 01) less 
anxiety and neuroticism. In the earlier study 
(6), highly significant relations were found 
between authoritarianism, manifest anxiety, 
and weak ego structure. In view of the fact 
that the two inventory measures of personal 
adjustment were significantly different in the 
present experiment, and the fact that the 
present clinical evaluation of ego structure 
was based on less information and informa- 
tion gained in an interview in which the Ss 
were trying to make a favorable impression, 
there is no doubt that the test of our hy- 
pothesized relation cannot be considered a 
crucial test. It is interesting to note, however, 
that the three measures of adjustment—ego 
structure, manifest anxiety, and neuroticism 
on the P-S Inventory—intercorrelate signifi- 
cantly. Thus, it appears that if the Ss were 
consciously trying to create an impression of 
good personal and social adjustment, as we 
infer, they were able to Present a consistent. 
though distorted, picture. Under this condi. 
tion of high ego-involvement, with much to 
be gained by presentation of a mature, well- 
adjusted, personality picture, we did not find 
a significant relation between the measures 
of authoritarianism and the measures of per- 
sonality. However, because of the peculiar na- 
ture of the assessment condition, which was 
necessary for testing the effect of ego-involve- 
ment on relations between authoritarianism 
and intolerance of ambiguity, we cannot ac- 
cept the present negative findings as conclu- 
sive evidence. 

For one thing, it should not be overlooked 
that each of the measures of adjustment cor- 
related in the predicted direction with the 
measure of authoritarianism. All these corre- 
lations are in the vicinity of .25 and, though 
they are not statistically significant and are 
not of equivalent magnitude to those obtained 
in the earlier study, the fact that we secured 
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even this magnitude of relation between w 
measures, as predicted, makes one think E 
there may well be a relation between pee 
tarianism and maladjustment. In view ci i 
fact we could not replicate our previous ion 
ings, however, together with the ser a 
negative findings reported by another inva 
gator (17), it seems highly probable tip o 
tion between authoritarianism and Dee 
personal adjustment may be of limite B 
erality. That is, the type of Ss being ae 
amined, the setting in which they ne 
amined, rapport, ego-involvement, and a ae 
of additional variables may have impok a- 
effects on this proposed relation. very atte 
nitely, there is need for further syste find- 
experimentation, with more conclusive con- 
ings, before it would seem justified wre 
clude that there is a general relation anes 
authoritarianism and personality i 
ment. 

At this point, let us consider th ation 
confirm the prediction concerning thene ce 0 
between authoritarianism and intoleran e- 
ambiguity. The assessment condition po 9 
signed expressly to permit further te ego- 
Brown’s (3) finding that under hig 
involvement there was a significant es 0 
tion between the F scale and ag re- 
rigidity or intolerance of ambiguity. + evi- 
sults shown in Table 1 provide a hy- 
dence that, in the present study, t tests 
pothesis was not confirmed. Chi-square 
of association between authoritarianism ive 
personal reactions to the auditory ane 
test support this conclusion. There Wa a 
significant relation between the F a i 
ratings of degree of ambiguity perce!’ sig- 
the auditory stimuli (x? = .19) and = rat 
nificant relation between the F scale an r 
ings of degree of liking or disliking f° ; 
auditory test (x? = .74). In other words, x- 
though in this experiment the Ss were ally 
amined under a condition of excep P z 
high ego-involvement, which should De e” 
ducive to securing the predicted positive |; d 
lation, we again found no significant o 
tion between authoritarianism and mert i 
of tolerance of ambiguous visual stimuli in 
ambiguous auditory stimuli. Thus, in tw? 
dependent studies we have been unable 


e failure to 


vet 


—— Ex -_ —— 
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secure results in keeping with predictions de- 
tived from reports of previous research. 
Two points should be emphasized in re- 
gard to the present findings. The first is that 
the F scale scores do not appear to Ďe coi 
sciously distorted. Contrary to the findings of 
significantly less manifest anxiety and neu- 
roticism in these Ss than in the research Ss 
in the earlier study, the mean F scale score 
for these Ss is actually slightly higher than 
the mean for the previous group. Thus, we 
infer that these Ss were not consciously try- 
ing to appear less authoritarian and that their 
scale scores are probably valid. The second 
ey point is that the correlation be- 
bi the F scale and number of Rorschach 
ejections is not far below the acceptable level 
of statistical significance and is considerably 
sa in magnitude than the comparable co- 
“lent obtained under non-ego-involved con- 
“Hons, We certainly can place little faith in 
ine Significant findings, but we would like to 
€rpret the present finding as at least sug- 
8estive that ego-involvement may be an im- 
Portant determinant of the hypothesized re- 
oe At any rate, further study of this 
at pe determinant seems both necessary 
Worthwhile. 
Pe other investigators, employing 2 Me: 
o Y of experimental tasks, have also failec 
ta ina a significant relation between authori- 
tianism and intolerance of ambiguity (9, 
, We would advocate considerable caution 
e Skepticism until the contradictory evr 
nce has been reconciled. 


we have more un- 
ence it seems best 
the general state- 
rigid or jntoler- 


ant of ambigui 
iguity. i 

th i omenan, we would like to apia 
of need for replication studies 10 this i 

research, In fact, more general practice : 
“plication of psychological experiments wo 
cem to be highly desirable. Tt appears tha 
ew investigators bother to repeat t 


heir own 
*XPerj i spen 
ae timents and few have the desire to SP! 
eir research time and energy 


periment that has already been done Ae 
ne else. However, when exact replicati 


Slightly modified extensions of p 
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ies result in similar positive findings one 
could then feel much more confident of the 
generality and consistency of the phenomena. 
‘And when several independent studies, which 
should logically bear upon common phe- 
nomena, yield negative or inconsistent find- 
ings the need for further experimentation and 
restricted generalization would become ap- 
parent. 


Summary 


The present study was concerned with rela- 
tions between authoritarianism, intelligence, 
personal adjustment, and intolerance of am- 
biguity. This experiment is an extension of an 
earlier study in which Ss who were relatively 
high on authoritarianism were found to be 
relatively low on intelligence, high on mani- 
fest anxiety, and low on ego structure. Con- 
trary to expectation, however, in the previous 
study no relation was found between authori- 
tarianism and intolerance of ambiguous visual 
and auditory stimuli. Since recent experimen- 
tal evidence suggested that ego-involvement 
may be an important determinant of the re- 
lation between authoritarianism and rigidity 


or intolerance of ambiguity, the present in- 


igati i if positive 
gation was designed to see it p 
a Id be obtained when the Ss were 


ighly ego-involving condi- 


tions. 
Twenty-two 

went a battery 

ment procedures 


male undergraduates under- 
of tests and personnel assess- 
under the assumption that 


logical screening. 
to conclude that the assessment 


ere seen as formal, 0 : 
threatening, and highly arias “4 
cluded in the assessment battery we! : pi 4 
] interview with a clinical psychologist, 
Se F scale, the manifest anxiety scale, the 
p-S Inventory, Rorschach concept evaluation 
technique, 40 an auditory test consisting 
of ambiguous spoken communications. Also, 
grade-point averages were obtained from the 
Ss’ academic transcripts. a 
The only prediction confirmed in this study 
was the finding of significant negative corre- 


the psycho 
warranted 
conditions W 
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lation between authoritarianism and intelli- 
gence as measured by academic achievement. 
Authoritarianism correlated in the predicted 
direction with the three measures of adjust- 
ment (ego structure, manifest anxiety, and 
neuroticism), but none of these coefficients 
were statistically significant. However, since 
the two inventory measures of adjustment in- 
dicate significantly less anxiety and neurot- 
icism in the present Ss in comparison with 
previously studied Ss, it seems that the ego- 
involving conditions probably led to con- 
scious distortion of responses to these meas- 
ures of adjustment. Therefore, these negative 
findings should not be regarded as conclusive 
evidence. 

No significant relation was found between 
authoritarianism and rejection of Rorschach 
concepts or recall of ideas contained in am- 
biguous spoken passages. Supporting this 
negative finding, there was also no relation 
between authoritarianism and a direct meas- 
ure of ambiguity tolerance based on the Ss’ 
ratings of their personal reactions to am- 
biguous auditory stimulus material. 

It was concluded that relations between 
authoritarianism, personal adjustment, and 
ambiguity tolerance are far from completely 
understood. It was suggested that these rela- 
tions are probably of limited generality and 
that attention must be paid to the factors in- 
fluencing them. And the need for replication 
studies was emphasized. 
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Ideational Expression of Hostile Impulses* 


Robert D. Wirt * 


Stanford University 


Pai ot is of major importance within 
tility ar y structure and feelings about hos- 
are a ae problems in psychotherapy 
hear = s widely held among contemporary 
sts and clinicians. Although considerable 

ad dec- 
i the expression of aggression, little 
demonstr al research has been carried out to 
tility or ate the relative importance of hos- 
Picture r proper place m @ comprehensive 
difficult ¢ personality dynamics. In fact it is 
in most ‘a find more than the bald statement, 
tant and heories, that hostility is very impor 
patholo that it is closely related to psycho- 
tween gy. It is with this relationship be- 
a. N and hostility that the 

oeeo 

release commonly helia that the unabashed 
normal aggression is due to a breakdown of 
Rieu e control, or to a pathological 
U in hostile elements of personality. 
offenders laws provide special treatment for 
ing N whose crimes were committed dur- 
sions a of “temporary insanity.” Expres- 
a ilo 4: as “he must have been crazy to do 
g like that” usually have reference to 


destructive acts. 
Te (8, 10, 11, 12, 13) put heavy em- 
sesh on hostility as a reaction to threat to 
dions Y, though in later elaborations of psy- 
deri nalytic theory (28) he shows hostility to 
(th ve from libido in combination with forces 
sti e repetition compulsion) © death in- 
inct. The early formulation is 


1p; 
win nis report is based in part © 
Co ed to the Department of Psycho : 
sity, mittee on Graduate Study of Stanford Univer” 
ai April, 1952. Tig writer wishes 
preranog to Professors C- L. Winder, 
ae and Douglas Lawrence for their generous 
IP in this investigation. 
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Now at the University of Minnesota. 


panded by Dollard and his associates (3, 4, 
21), but hostility becomes quite simpl ya 
innate response to frustration. Neo-Freudian 
theories (8, 14, 16, 18, 19, 22, 23, 25, 27 
28) view hostile expression more dearly w 
terms of interpersonal relations and most of 
these theorists see hostility as arising as a 
natural reaction to frustration with its con- 
trol and expression being governed by mores 
of the society- With a breakdown of tolerance 
for frustration (or “ego disorganization”) the 
individual is expected to display increased 
aggression and increasingly inappropriate ex- 
ression of hostile behavior. Murray (22) 
explicitly states that there is a direct rela- 
tionship between hostility and psychopathol- 
ogy, neurotics being more hostile than nor- 
mals; and psychotics, he asserts, are most 
hostile of all. Cultural anthropologists and 
sociologists have stressed the differences in 
the freedom of expression of aggression among 
members of differing social groups (2, 29). 
Presumably this leads to differences in the 
degree to which hostility is a problem for 
members of these groups. 
In general, then, there is some agreement 
among various eorists that hostility is of 
central importance in psychopathology and 
that its expression js modified by social ex- 


are raised by this sum- 
directly related to the de- 
the broadest mean- 
e true, at the very 


al individuals will express less hos- 
tile ideation than neurotics, who will express 
less than psychotics. Hostile ideation must be 
a precursor (or concomitant) of aggressive 
behavior since no matter how repressed the 
hostility may be, if it is really a problem it 
must eventually, no matter in how disguised 
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a form, be expressed ideationally. Further- 
more, if the expression of aggression is bound 
by cultural controls one might reasonably ex- 
pect to find differences in the amount of hos- 
tile ideation expressed among different sex, 
age, educational, and socioeconomic groups; 
presumably women and persons more fre- 
quently and longer exposed to the societal 
values have more opportunity and more pres- 
sure to learn the control of hostility and less 
freedom for hostile expression. Beyond this 
there may be differences in the mode of such 
expression. 


Procedure 


Finney’s Palo Alto Aggressive Content Scale 
(6, 7, 26) was used as the measure of hostile 
ideation. This scale is based upon the Ror- 
schach content. Rorschach (24) originally 
suggested his technique as a test of ideation. 
It provides a standardized situation in which 
symbolic as well as less disguised thought 
processes are elicited. The Finney scale was 
used, instead of similar scales, such as that 
by Elizur (5) because its scoring is more ob- 
jective (15); it has distinguishable categories 
of hostility and it has been demonstrated to 
separate validly groups of known assaultive 
individuals from nonaggressive persons (26). 
Four categories for classifying aggressive re- 
sponses are provided: Derogatory Remarks, 
Victim of Destruction, Possibly Destructive, 
and Active Destruction. Any response can be 
categorized as nondestructive or as falling 
into one or two of the above categories of 
hostility. 

Three groups were taken for the sample: 
a group of 76 normal, 32 neurotic, and 50 
schizophrenic individuals. An effi 
to stratify the grou 
would compare wi 


é ort was made 
ps in such a way that they 


y e th the general population 
m age, education, and socioeconomic status, 


The normal group contained 38 men and 38 
women, selected from the community among 
persons without psychiatric diagnoses. All in 
the abnormal groups were male patients at 
the Palo Alto Veterans Administration Hos- 
pital. These were individuals whose diagnoses 
were not complicated by known organic con- 
ditions or by admixture of other psychiatric 
reactions and for whom the Rorschach did not 
contribute in the diagnostic study. The char- 


D. Wirt 
Table 1 
Summary Data from Distribution of Raw Scores 
Schizo- 
. ic 
Distribution of Normal Neurotic ae) 
responses (V=76) (N= 32) U 
sae aaaaal was sae 1780 
S D 11.76 16.20 " 
Ae responses :} ens wis 10 
SD 4.31 10.74 à 
a cae responses: mem iaa 1132 
SD 955 97 ” 
“Victim” responses: 7 4.44 
M i 2.60 5.00 516 
SD 2.17 7.84 i 
“ » 4 6 
sas ed responses :} ae 5.19 ai 
SD 3.34 5.05 
A than 
i ssive re: se can be scored in more the 
eae Seer an te Saas Of responses will nor essiVe 


ber of nonagere 


“ plus 
“uyictim" P 
t Aggressive responses equals the sum of remarks 
‘aggressor’ responses. atory ri 
t Aggressor responses equals the sum of Deroge esponses © 
plus Possibly Destructive plus Active Destru 
the Finney Scale. 


exact sum of number of aggressive plus num 
responses, 


«| more 
acteristics of the sample are described 


fully elsewhere.? 

The Rorschach protocol of eac 
was scored by the Klopfer and Kelley 
(17) and the responses rated on the onses 
scale. Ratings of a subsample of 393 en in- 
gave 95 per cent agreement between t™ 
dependent judges. 


h individual 


syste™ 
Finney 


Results 


Table 1 contains the summary d 
distribution of aggressive responses. 
tal number of responses” is R in 
terms, and it includes all responses, 
tile and nonhostile; “number of ager y er 
responses” refers to the sum of all fout none 
gories in the Finney scale; “number (0) onses 
aggressive responses” includes those resP ries; 
not contained in one of Finney’s cates? the 
number of “victim responses” refers el e5 
category of Victim of Destruction ee ge f 
in the scale; and number of aggre? e7 
responses” refers to the sum of all four : y 
gories: Derogatory Remarks, Possibly 
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Ideational Expression of Hostile Impulses 


structive, and Active Destruction. An aggres- 
sive response can be scored in as many as 
two categories. In the sample used here there 
was an average of less than one-half response 
per record requiring double classification. 
‘The mean number of responses for the 
schizophrenic group, 17.80, is considerably 
less than that of the neurotic group, 23.72, 
or of the normal group, 23.03. The correla- 
tion between number of responses and num- 
ber of aggressive responses is 60 for nor- 
mals, .83 for the neurotic group, and .63 for 
the schizophrenic group. This suggests, as one 
might expect, that there is a tendency for an 
ee number of aggressive responses tO 
e associated with increased responsiveness. 
Total number of responses tends to be asso- 
ciated with any measure On the Rorschach 
that is quantitative, since the more responses 
an individual gives the more likely he is to 
‘crease the number of responses in all cate- 
Bories. In order to partial out the influence 
k i e number of responses, an analysis of co- 
Variance was computed with number of ag- 
ve responses and total number of re- 
— a as variables. The same procedure was 
sed to test the differences between pairs 0 
fenus; The analyses show demonstrable dif- 
ences in the hostile ideation of these groups. 
able 2 gives the results. _ 
a the results shown in this table indicate, 
foes group differs from each other group, ane 
ra is a highly significant difference among 
the three groups. When the means are ad- 
Justed according to the results of the covarl- 
ance analysis by the method suggested by 
McNemar (20, p. 328), it cam be seen (Col- 
on at Table 3) that the groups do not fal 
e predicted order. 
The onka factors were tested by two 


Table 2 


F Ratios for Analysis of Covariance 
for the Three Groups 


F Ratio 


6.69** 


Normal ys, Neurotic vs. Schizophrenic 3.69** 
Ormal vs. Neurotic yor 
ormal ys, Schizophrenic 5.83* 


Curotic vs. Schizophrenic 


* Significant beyond the 05 level. 
Significant beyond the .01 level- 
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Table 3 


Means of Aggressive Responses 


Raw-score Adjusted Rank 

Group means means order 
Normal 6.96 6.36 1 
Neurotic 10.19 9.38 3 
Schizophrenic 7.60 9.07 2 


methods: analysis of covariance and a chi- 
square method suggested by Cronbach (1, p- 
411). This method successfully controls the 
effect of total number of responses when dif- 
ferences such as number of aggressive Te- 
sponses are being studied among groups. Dis- 
tributions covering the entire range of each 
factor were made for three categories of age, 
four categories of education, and four cate- 
gories of socioeconomic status of each group 
and between the sexes for the normal group. 
None of these was related to the expression 
of hostile ideation in significant degree. In 
the case of the abnormal groups the relation- 
ship was even less pronounced than in the 
normal group, put in no group did either the 


chi square or the F ratio approach an ac- 


ceptable level of statistical significance. The 
Pearson correlation between age and number 


sive responses Was only — 04. 

. ee of r nses was divided 
sm? 

into those represen jm” and those 
i “aggressor,” and Cronbach’s chi- 
r ied. This method failed 
in direction of puni- 
wever a clear 
iti ss to be 
found. The F 


sq 
to show any 
tiveness for the socia 
tendency for direction 


S chopatholog, ; 
rela E a Tai of covariance for 


responses with the 
g significantly more 
“victim and the neurotic group 
falling in De 
istic direction. 


Discussion 
Clearly these results lead to the conclusion 


that it requires & complex analysis of person- 
ality factors in addition to hostility to classify 
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individuals, even grossly, along a continuum 
of psychopathology. Individuals in all of the 
groups were found throughout the entire 
range of ideational expression in all of the 
categories of aggression. It would seem that 
hostility cannot be taken necessarily to be a 
critical factor in the mental health of an in- 
dividual. But the group differences are sig- 
nificant and the severely ill individuals were 
shown to be more expressive of hostile idea- 
tion than the normal group. Furthermore, 
there was a definite tendency for the groups 
to show differences in the direction of expres- 
sion of hostile impulses. This investigation 
suggests that those theories relating hostility 
to psychopathology are substantially correct, 
but it will require further elaboration for a 
theory to account for individual differences 
and for the greater ideational expression of 
hostile impulses by neurotic individuals. 
Hostility certainly is a critical factor in our 
Social intercourse. This research seems to 
confirm the assertions of some theorists that 
hostility is common, primitive, and pervasive, 
But few differences, and no significant ones, 
were found among different social, economic, 
age, or educational groups. This would sug- 
gest that the effectivenes, 
cialization in the handli 
leaves much to be desire 


. Soup), were compared 
ideational expression of 
nd on Scoring their Ror- 
sing Finney’s Palo Alto 


on the amount of 
hostile impulses fou 
schach protocols y 
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Aggressive Content Scale. A statistically sig- 
nificant difference in hostile ideation was 
found to exist among the three gon E 
between any two. The normals aow ‘ie 
least hostility, next were the schizop: he 
and the neurotic group scored the seg ate 
groups showed a significant difference an 
direction of punitiveness, with the A the 
group tending to direct hostility eee 
schizophrenics inward, while the direction: 
group showed no characteristic a or se 
None of the age, educational, social, nt in 
differences were statistically ren 
the amount or direction of hostile ide that 

The results were interpreted to nage in 
many contemporary theorists are ilate to 
stating that hostility is directly = are iD 
profundity of illness and, further, t js neces- 
error in assuming that great hostility be it 
sarily an indication of pathology. pa clearly 
was emphasized that the results expres- 
demonstrate a tendency for greater rl 
sion of hostility among groups q with nor- 
mentally ill individuals as compare ressio® 
mals and that the direction of Fled ou 
characteristically differs. It was PoP Jaiming 
that the lack of support for theories c Sire is 
that hostility is amenable to social Pr dagosici 
not, per se, proof that cultural, Pran th 
efforts are limited, but rather may 2 the €% 
the present methods used to contro Further 
Pression of hostility are inadequate. p idea 
research into the relationship ui hostile 
tional and behavioral expression © 
impulses is indicated. 
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The Attitudes of the Mothers of Male Catatonic and 
Paranoid Schizophrenics toward Child Behavior 


Arnold P. Goldstein and Arthur C. Carr 


Creedmoor State Hospital 


The study was designed to determine if the 
attitudes of mothers of catatonic schizophren- 
ics to child behavior differ from the attitudes 
of the mothers of paranoid schizophrenics, 
testing the hypothesis derived from the re- 
cent suggestion of Arieti (1) that catatonics 
are persons who as children were criticized 
for their actions, while paranoids were criti- 
cized for their intentions and for lying. 

A questionnaire of 56 items related to 
child-raising attitudes was composed, borrow- 
ing from statements which Mark (2) found 
highly differentiating between mothers of 
schizophrenics and nonschizophrenics. Items 
from his scale and newly composed items 
were selected in terms of their relevance for 
the hypothesis. 

The attitude scale was administered to 60 
mothers, 34 of whom had sons who were pres- 
ently diagnosed as catatonic and 26 who had 
sons diagnosed as paranoid. Only clear-cut 
cases of each disorder were chosen. The two 
groups’ responses to these items were com- 
pared, item by item, by means of chi square. 

Results of the statistical analysis offered 
no support for the hypothesis, as only 3 of 
the 56 statements differentiated the groups 
at the .05 level of confidence or better a 
number not sufficiently in excess of that E 
pected purely on a chance basis. 


1 An extended report of th; 
tained without charge from 
moor State Hospital, Queens 
for a fee from the American 
tute. Order Document Ni 


is study may be ob- 
Arthur C. Carr, Creed- 
Village, New York, or 
Documentation Insti- 


„Ord r 0. 4814 from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 


brary of Congress, Washington 25, D. Gi remitting 
in advance $1.25 for microfilm or $1.25 for photo- 


copies. Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress, 


ed 

An unexpected finding, however, aP! ee 
to offer some support for the ene a 
catatonic schizophrenics’ mothers may degree 
conflict over “choice of action” to i were 
not found in the mothers of pauni w. 
paranoid. Of the mothers solicited, ter fre 
of catatonics with a significantly Pro 
quency reported themselves ma to do 50 
plete the questionnaire, and refuse tudy; 7 
Of the mothers cooperating in the s flecti 
fusal to answer individual items as is times 
in the omission of answers occurred thers 45 
in the responses of the catatonics a aprile 
opposed to only 10 times in the resP 
the mothers of the paranoid patients. fered 

The limitations of such evidence a be d& 
by studies comparable to this canno al 
nied in view of their failure to rule 
differential effects of the illness itself, ation 
as numerous other more complicated ‘sible e 
ships which are difficult if not impos?” o 
control. Evidence related to the eront time 
schizophrenia, however, is at the ea that it 
totally so far from being unequivoc® tain 
would appear that one can only mar anit 
open mind, accepting and evaluating “ations 
lating evidence in the light of its lim" evi 
until such time as the definitive, cruci 
dence is available. 


Brief Report. 
Received January 19, 1956. 
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Th ; 
e Effectiveness of Psychotherapy with Individuals 
Who Have Severe Homosexual Problems 


Albert Ellis 
New York, New York 


Alth 
ee AKI writers on homosexuality 
its tresia e metes character and minimized 
includin pad contemporary investigators 
Gwe ea” 2), Cory (3), Creadick 
(8, 9) 5 (5, 6), Anna Freud (7), Henry 
don and or (12), Lewinsky (13), Lon- 
(16), Sr aprio (14), Nedoma (15), Poe 
Ri sea and Freund (17), and Westwood 
if fee to view homosexuals as suitable, 
orat subjects for psychotherapy: Un- 
contains n however, the recent literature 
Sizable nu oe of the treatment of a 
eal paler er of cases, with an attempt to 
Variables ically with some of the important 
The a in such treatment. 
$ (28 m e paper reports on 40 individu- 
for five ales and 12 females) who were seen 
the states more psychotherapeutic sessions in 
951 a s private practice during the years 
Were "lB Shem Thirty-six of these patients 
four (2 ing overt homosexual relations; W: ile 
ia and 2 females) were not overt 
Sexual “on but were obsessed with homo- 
Soon Peas ie and were afraid that they 
te secs become inverts. 
apse these individuals with severe 
Choanal al problems, an active form of psy- 
emplo pulpal’ psychotherapy was 
goals yed, and one of the main therapeutic 
fear teas to help the patient overcome his 
impro heterosexual relations anc, 
ved sex-love relations wi me 


eo 
ee sex, to minimize his 
s and activities. The therapeutic 80% 


Ww 
a na that of inducing the patient 
as oe interests because, 4 
eu inted out previously (9 t 
nrealistic. The neurotic 


al 


pea ie ee aig i activity or 
7s is biologically a bi- 
sexual or plurisexual animal who, to some d 
gree, may be considered rare ie abnormal s 
he has absolutely 70 homoerotic desires Or 
participations during his entire lifetime. The 
abnormality in homosexuality consists of the 
exclusiveness, the fear, the fetishistic fixation, 
or the obsessive-compulsiveness which is 20 
often its concomitant. The aim of psycho- 
therapy; therefore, should be to remove these 
elements: to free the confirmed homosexual 
of his underlying fear of or antagonism to- 
ward heterosexual relations, and to enable 
him to have satisfying sex-love involvements 
with members of the other sex- 

The 40 individuals surveyed in this paper, 
then, were treated for their homosexual prob- 
lems or neurosis rather than for their homo- 
sexual desire oF activity pet S They were 
deemed to pe distinctly of considerably im- 


proved when, 


therapy, they 
to enjoy hetero 


erately oF 
12 were very severely emotionally disturbed. 
One had a grade-school education; ten were 


on the high-school level; 23 had some col- 


lege training; and 6 had done graduate work. 


EEE 
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Results 


The data gathered by treating 28 males 
and 12 females with serious homosexual prob- 
lems with active psychoanalytically-oriented 
psychotherapy are shown in Table 1. From 
this table some interesting sex differences may 
first be noted. The female patients were more 
improved as a result of treatment, more often 
married or divorced, and more often evalu- 
ated as very severely emotionally disturbed. 
When tested by chi-square analysis, these dif- 
ferences all proved to be significant at the 
.05 level of confidence. There were also non- 
significant tendencies for the female patients, 
when compared to the males, to be less edu- 
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square analysis was that between the H 
tients’ desires to achieve heterosexual a a 
ment and their benefiting during the e a 
of psychotherapy. Thus, of the 10 in 
als who showed little or no itpro n e 
displayed little or no desire to achieve es 
sexual adjustment; and of the 30 who g is 
distinct or considerable improveměñt; se j 
played little or no desire to achieve pa 
sexual adjustment. Using Yates s$ Ca erence 
for small cell frequencies, this ak i 
proves significant at the .01 level 0 
dence. wd 
Relationship differences which are sugges 


ich do 70 
by the data of Table 1 bit hamr includ} 
cationally advanced, to have had more hetero- prove to be statistically ol ae seeme 
sexual activity, and to be more desirous of these: (a) The better-educate treated. (b) 
making a better heterosexual adjustment. to improve more while being E improved: 
The only other relationship in Table 1 that The less-disturbed males were mo were more 
Proved to be significant when tested by chi- but the more-disturbed females 
Table 1 
Relationships Between Benefits Received with Psychotherapy by 28 Male and 12 Female 
Homosexual Patients and Selected Other Variables 
Number of patients benefited with psychotherapy 
Little or no Distinct Considerable Total ; 
improvement improvement improvement f 
x EEA M 
Variable M F M F M F 

Age 12 $ 
Under 28 $ 
28 and over 5 o 3 3 5 ; 16 

Marital status i 1 9 5 ; 
Single 2 6 

Bor 9% 0 7 2 9 4 3 
Married, divorced, 

Education snespetated 1 0 0 2 2 4 g 4 
Grade or high school 8 
College or graduate school F o 0 1 1 3 23 

Clinical evaluation 7 3 10 5 
Moderately or distinctly 4 

emotionally disturbed 6 0 20 8 
Severely emotionally disturbed 4 0 5 2 9 2 8 
Extent of heterosexual activity 2 2 2 $ 
before therapy 6 
Little or none 8 20 6 
Moderate or considerable 2 a 7 3 5 3 8 
Desire to achieve heterosexual 9 0 1 6 5 
adjustment 7 
Little or none 5 0 5 3 
Moderate 5 o 0 1 0 1 10 1 
Considerable 0 o0 4 2 1 1 13 
Length of treatment 3 1 10 6 4 
5 to 19 sessions 8 0 17 8 
20 to 220 sessions 2 0 ; 3 11 
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sae with treatment. (c) Individuals 
belies engaged in little or no heterosexual 
— y prior to treatment were more improved 
in T psychotherapy. (4) The greater the 
rten | pupe the more was the 
tests EA the patients to improve in the 
Bo whole, the results—or at least the 
with ne earn employing psychotherapy 
Broblem ividuals having severe homosexual 
tiale ms seemed to be favorable. Of the 28 
be peg 10 (36 per cent) appeared to 
cent) a or not at all improved; 7 (25 per 
cent) a improved and 11 (39 per 
Hale — EN improved. Of the 12 fe- 
be cA tag 4 (3314 per cent) appeared to 
čonsider z improved and 8 (67% per cent) 
female ss ly improved. Of the 20 male and 
little patients who entered therapy with 
ve or moderate desire to overcome their 

i problems (but who camés in- 
to rel; mainly to work on other problems or 
0 (50 their guilt over being homosexual), 

and 3 per cent) achieved some improvement 
impro (15 per cent) achieved considerable 
f laa in their heterosexual relations. 

a Sf 20 patients who came to therapy with 
Sn desire to overcome their homo- 
and oe all made some improvement 
Proy (80 per cent) made considerable im- 
ement in their sex-love relations with 


me 
mbers of the other sex. 


Discussion 


ea must be duly sceptical of the results of 
other ee as with the results of most 
Crite Studies of psychotherapy, because the 
ent rion of improvement utilized is depend- 
teme the subjective statements of the pa- 

I S and judgments of investigator. 
fen no control group of sit 
W. s who had not been therape 
as utilized. Hence, all that is known, at 
est, is that the patients of this study im- 
Proved with, and not necessarily because OJ, 
Psychotherapy. 

Assuming that the therapy did, 
extent, help these patients mak 
oe adjustment, it may 
why the females, in spite of 
turbance, improved significantly 
than did the males. There may 


to some 
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sible reasons for this difference: (a) Through 
relating to a male therapist, they may have 
more easily overcome their fear of and/or 
antagonism to males. (b) Because they can 
consummate coital relations with little diffi- 
culty once they decide to risk doing 50, fe- 
males may be more willing than males to 
make a sincere effort to engage in sex-love 
involvements with the other sex. (c) Since 
the females in the present sample had had 
more heterosexual activity than had the males 
at the time they entered psychotherapy, they 
may have found it easier to give themselves 
more wholeheartedly to heteroerotic relation- 
ships. (d) The females studied were more de- 
sirous of achieving better adjustments with 
members of the other sex than were the males 
—and this desirousness was found, in the 
present study, to be significantly correlated 
with clinical improvement. 

Two interrelated questions may be asked: 
(a) Why were so many more homosexual 


males than females seen as patients? (b) Of 


the females who were seen, why did they tend 
the males? 


to be more disturbed than were 
The answer to the first question probably 
is that, in our society, there are many more 
confirmed homosexual males than females— 
a point on which Cory (3), Kinsey and his 
associates (10, 11), and other authorities 
seem to agree. "This may be because the sexu- 
rally) inadequate male in our 
be more rejected by 
women than the inadequate female will be 
rejected by men. tend to 
seek romantic 
tachments in 
satisfaction, = 

tility towar men. 
yee h therefore, will resort to ng 
sexual activity, many equally jnadequate te- 


„ill take refuge in frigidity. 
er Fa is true, it may be predicted that 
women who do become Lesbians will tend to 
be more emotionally disturbed, on the whole, 
than male homosexuals. This is exactly what 
has been fou 


Where many jnade- 


nd in the present study. At the 


it should be noted that 29 per 


same time, ! 
cent of the males and 67 per cent of the fe- 


males studied were found to be very severely 
emotionally disturbed—a quite high percent- 
age in both instances. This is probably be- 
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cause confirmed homosexuals are, on the 
whole, exceptionally disturbed individuals— 
which one would expect to be the case with 
persons who overtly surrender such an im- 
portant characteristic as their fundamental 
sex role and who, in addition, are usually 
severely frowned upon and persecuted by the 
rest of their society. 

The obtained significant relationship be- 
tween the patients’ improvement in hetero- 
sexual relationships and their desire for such 
improvement seems understandable enough. 
This is often true for all kinds of disturbed 
individuals: those who really want to get 
better, and who will do the hard work re- 
quired in the course of active psychoanalyti- 
cally-oriented therapy, almost invariably im- 
prove considerably, and often in a relatively 
short length of time. Homosexuals, in particu- 
lar, who are essentially phobic in that they 
fear sex-love involvements with the other sex 
and take what seems to be the “easier” way 
out of homoeroticism, can, like most other 
phobics, overcome their neurosis if they will 
(a) acquire insight into the origin of their 
fears and (b) begin to participate in the ac- 
tivity they fear. If, with the help of good 
Motivation, they will permit a competent 
therapist to help, persuade, cajole, and goad 
them into acquiring this insight and doing 
what they illogically fear, they will usually 
succeed in Overcoming their homosexual neu- 


rosis. 

Assuming that the Psychotherapy received 
by the individuals studied actually helped 
them in ov 


ercoming their severe homosexual 
problems, the writer’s impression is that the 
following therapeutic techniques were impor- 
tant in this respect: (a) The therapist was 


quite accepting and noncritical in relation to 
the patients’ 


exclusive, fetishistic, an 
homosexuality. (b) Th 
sist that the patients overcome all their homo- 
sexual tendencies, but accepted many of these 
tendencies as normal or idiosyncratic. He em- 
phasized the patients’ becoming more hetero- 
sexual rather than less homosexual. (c) The 
therapist showed, by his manner and verbali- 
zations, that he himself was favorably preju- 
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diced toward heterosexual relationships. (2) 
Special attention was usually tonnent i 

the patients’ general antisexual attitu = = 
an active attack was made on his a 
sexual guilt and shame. (e) In eyy 
there was as much focusing on the in E 
als general feelings of ape pe 
his sex problems. A major goal 0 at ee 
was always the achievement of general Cb 

strengthening, on the assumptio 
sive homosexuality often follows from 
in turn the further cause of, severe 
of worthlessness. (f) Wherever ae 
patients were persuaded to engage 1m het oe 
relationships with members of the Oral 
and to keep reporting back to the ae a 

for specific discussion of and pos 

with these love relationships. 


feelings 
ble, the 


Summary and Conclusions 


Twenty-eight male and twelve fe roblems 
dividuals with severe homosexual p of ac 
were seen for from 5 to 220 ESO terms 
tive psychoanalytic psychotherapy: iva 
of their achieving satisfactory sex- abe 
tions with members of the other sex, atients 
found that 36 per cent of the ma cen 
were little or not at all improved; 7 Propsit: 
distinctly improved; and 39 per p 334 
erably improved. Of the female as 24 pet 
per cent were distinctly improved; 
cent considerably improved. d to be sig” 

The female patients were found treate® 
nificantly more improved while hona more 
more often married or divorced, 4 rbed i 
often evaluated as very severely EA 
dividuals than were the male patien A 

A highly significant relationship W ats’ 
between both male and female paner nd 
Sires to achieve heterosexual adjust pa 
their benefiting during the period © 
therapy. 

Although due caution must be ™ 3 
in generalizing from this study, it ae tha 
there are some grounds for believing ori 
Majority of homosexuals who are $ willing 
concerned about their condition an i of 
to work to improve it may, in the ©? othe” 
active psychoanalytically-oriented IDA ot? 
apy, be distinctly helped to achieve 
satisfactory heterosexual orientation. 
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Homosexuality and the Rorschach ` 


Carl J. Nitsche, J. Franklin Robinson, 


Children’s Service Center, Wilkes-Barre, Pennsylvania 


and Edward T. Parsons 


The Pennsylvania State University 


This study was an attempt to determine 
whether certain Rorschach content categories 
occur more often in protocols of homosexuals 
than in those of nonhomosexuals. 

The Ss, 38 white males referred to the 
Adult Mental Health Clinic, were divided into 
two groups: 19 recently convicted homosexu- 
als and 19 patients with no known homosexual 
activity. 

Twelve content categories were selected 
from studies by Due and Wright (1), Ulett 
(4), Chapman and Reese (3), and Fein (2): 
mythical distortion, qualifications toward the 
abnormal, dehumanization, double identifica- 
tion, uncertainty, evasiveness, projection of 
feminized behavior, preoccupation with femi- 
nine apparel, castration and phallic symbol- 
ism, sexual and anatomical responses, esoteric 
language and artistic references, dislike of fe- 
male genital symbols. 

The number of responses in each of these 
categories was determined for each S of the 
two groups and expressed as a percentage of 
the total number of responses of each S, This 


1An extended Teport may be obtained without 
charge from C. J. Nitsche, Children’s Service Cen- 
ter, 335 S. Franklin St., Wilkes-Barre, Pa., or for a 
fee from the American Documentation Institute. To 
obtain it from the latter, order Document No 4811 
from ADI Auxiliary Publications Project. Photo- 
duplication Service, Library of Congress, Washin, = 
ton 25, D. C, remitting in advance $1.25 for ‘flere 
film or $1.25 for Photocopies. Maki 


1 e checks payabl 
to Chief, Photoduplication Service, Library of ioe 
gress. 


. and sexual and anatomical response 


tas separ 
was done for each of the 12 categories Sne j 
rately and for the 12 categories = sot? 
The means, standard deviations, an 


seen means 

ard error of the difference between 
were computed. sponses 
i had more respo?” 
The homosexual group did the non 


in 9 of the 12 categories than were 
homosexual group, but the omg evel: 
not statistically significant at the - A 
Mean for the homosexual group Was 
sponses in the selected categories, 
nonhomosexual group, 2.7. Of th Jism; 


1 J ic symbo 
categories, castration and phallic 7 occurre 
, 


mosexu@ 


most often in both groups. The ho esponses 
u 


group had no double identification - 
and the nonhomosexual group, 1 


islike of fe- 
identification, evasiveness, or dislik 
male genital symbols. 
Brief Report. 
Received February 14, 1956. 
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Relationship of Sexual Adjustment to Certain Sexual 
Characteristics of Human Figure Drawings 


Carl N. Sipprelle and Clifford H. Swensen 


University of Tennessee 


n- pe aspects of human figure drawings 
aloe | used as indices of the sexual 
exam ao and adjustment of subjects. For 
Stee Ns Machover (4) states that “some de- 
ords of sexual inversion was contained in rec- 
Sex fir all individuals who drew the opposite 
a pe st in response to the instruction, ‘draw 
rson’.” 
sae es the object of this investigation to at- 
ie to determine what relationship existed 
hera i the sexual adjustment of psycho- 
Pect: by patients and some of the sexual as- 
s of their human figure drawings. 


Procedure 


Si subjects (Ss) consisted of 25 men and 
of T men in psychotherapy at the University 
wa mrad Psychological Service| Center. 
signe these Ss were seen only for diagnostic 
apy in and interview, 1 was seen for 4 ther- 
20 tee 11 were seen for from 8 to 
5 ne interviews, and the remaining 3 
Teer: seen for more than 20 interviews. 
inter ty-four of the Ss were seen in over 
views. Three of the Ss were in therapy 


wi 
with graduate students in the last year of 


clini Ta s 
inical training, and the remainder were seen 
th three or 


y Ph.D. clinical psychologists wi 
Ore years of experience in psychotherapy- 
All Ss were routinely given the Draw-A- 


Person Test when they applied to the Service 


Fg for treatment. The sex of the first- 
rawn figure was note and the drawings 
Were rated on sexual differentiation using & 

i (6). The 


Scale described in a previous paper 
male figures for the men 20 women were 
ranked for masculinity and the female figures 
were ranked for femininity, by two independ- 


ent judges, and the rankings 


judges were averaged. The reliability of rank- 
ings was determined by correlating the rank- 
ings of Judge 1 with the rankings of Judge 2. 
The correlations for the four rankings ranged 
from .50 to .84, with the average falling at 
63. Although the lowest reliability coefficient 
(.50) is not particularly impressive, it was 
significant at the .01 level. 

The therapists rated their patients on a 
“sexual adjustment rating scale.” This scale 
consisted of eight subscales, with five points 
on each subscale. The subscales were: (a) re- 
ported frequency of intercourse, (b) social 
behavior with opposite sex at dances, dates, 
parties, etc.; (c) attitude toward sexual 
partner, (d) guilt over techniques for sexual 
expression; e) homosexual vs. heterosexual 
orientation; (f) attitude toward opposite sex; 
(g) symptoms relating directly to sex; (h) 
discussion of sex in interview. Each point on 
the subscale was © numerical value, 
with 1 being “good” adjustment and 5 being 


j t. The ratings for the sub- 
a total score 


minimize the poss 
raters were asked to rerate eac. 
] ratings were made 


months after the original ratr 
in order to check the reliability of the rat- 


ings. The reliability coefficients were all sig- 
nificant at well over the 01 level, and aver- 
aged .78. - 

The relationships obtaining between the 
sexual adjustment scales and the drawings 
were determined by the chi-square technique 
for each sex group. That is the men Ss (N 
group and the women Ss 


(N= 24) made up 4 separate group. 
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Table 1 


Relationships Among Sexual Adjustment Scales and Human Figure Drawings 


Sexual Masculinity Femti E 
j - exual D i 
eee Posie differentiation male figure fenebe 
wW M w 
Seales M w M w M = = 
7 65 68 00 
3.23 294 TO 217 = 3 
= 81 1.08 -70 75 2.61 3.00 65 00 
2 81 4.00* .70 -76 65 -00 65 2.71 
3 80.00 280 00 00 2.71 6 tH 
E 90 89 83 2.71 .00 68 “at 68 
F 3.23.89 00 68 6 68 a 28T 
G 84.00 307 295 ‘00 72 = 8, 
H 3.23 88 .00 2.71 65 -68 ‘00 3.90 
Total 81 -00 .00 75 .00 3.00 äi 


* Significant at .05 level. 


Results and Discussion 


Of 72 computed statistics, only two were 
significant at the .05 level. These results are 
contained in Table 1. They show that women 
who tend to draw the female figure first also 
tend to be dissatisfied with their sexual part- 
ners and that the women who draw the more 
feminine female figure tend to be better ad- 
justed sexually, as measured by the total 
score on the sexual adjustment scale, How- 
ever, such a small number of significant sta- 
tistics out of such a large number of com- 
puted statistics are undoubtedly due to 


chance. It would appear to the authors that 


these results are in agreement with those of 
Fisher and Fishe 


r (2). Although they con- 
cluded that women who draw female figures 
of average femi 


ninity tend to adjust better 
sexually than women who draw figures that 
are extremely feminine or masculine, it will 


be noted that out of the Fishers’ 48 com- 
puted statistics only eight were significant at 
the .05 level. 

It will be noted that there was no signifi- 
cant relationship between the sex of the first 
drawn person and sexual adjustment. These 
findings are in agreement with those of other 
investigators (1, 3, 5). 

These rather disappointing findings with 
the DAP suggest that the DAP is either an 
insensitive instrument or an unreliable one 


f 
indicator ° 
which is useful only as a gross indica 
psychodynamics. 


Summary 


; were 
Forty-nine psychotherapy patients idk 
rated by their therapists on sexua be: 
ment. Several sexual aspects of me pi oe 
human figure drawings were rate! elation- 
found that there was no meg vel 
ship between the patient’s sexual ad) a 
and the sexual characteristics of their 
figure drawings. 


Received August 29, 1955. 
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1 Concomitants to Rate of Recovety 
from Tuberculosis’ 


e W. Fairweather, Seymour Fisher, 


and Robert B. Morton 


vA H ospital, Houston, 


The presence of psychological determinants 


rs aeg of recovery from tuberculosis aP- 
Deli have gained wide acceptance among 
is esi in the treatment of tuberculosis. It 
literat mon to find in the extensive medical 
Wither on the subject statements such as 
iy a ower’s that, “sometimes it m 
of infer the patient’s prognosis on 
thas personality and his emotion: 
(4 on the basis of the shadow on 
» D. 202). 

oa in recent years, however 
Siden, been made to furmis 
almos a for this conviction, wh i 
the im exclusively on clinical observation. In 
type ain, these studies One 
ana Ais study draws up 
A the ntensive study of selected 

HP ga of abstracting person 
TER er fo account, for differences 
those Ty. Representative of suc 
(1) of Benjamin, Coleman, 
The os Wittkower, 
hos T investigators emphasize 
size = y and the second i 
as d e nature of defenses ag 

eterminants it tale Of OPP 


Texas 


ombinations of MMPI scores. 


use of various C 
ese studies have been essen- 


The results of th 


tially negative. 
t study is designed to examine 


the rate of recovery 
of tuberculosis patients and four psychologi- 
cal variables: (a) behavior on the ward, (b) 
attitudes toward the hospital environment, 
(c) past pehavior before hospitalization, and 
(d) fantasy as measured by the Thematic 


Apperception Test (TAT). 


Method 

The length of time required for the patient 
to negative bacteri- 

d as the criterion for rate of 

Routme laboratory reports are made 


on the hacteriological status of the patient’s 
i i ts. A negative re- 


ten 
e of tubercle pacilli 


en. For purposes of 
ive negative labo- 


ratory 
«converted, 
pacteriological y- À 
a! tudied were also subjects 

ch on the effectiveness O 
purposes of this latter 


subjects were excluded who pre- 


erculosis. 
j se “i second type of study seeks Jate test roject, c \ 
A len to specific criterion groups f l ted complications for an me of 
‘| (3) recoverers. Typical of t ese ar 0 ce hemotherapy» as previous Gug treat- 
ak study, which used a wice variety O° (2) ment, certain 00! T diseases, etc. Also, sub- 
N ach scoring variables, 4 tman’s jects whose physical ae a the 
eu) ri i e the ge random assignment O certain drugs were ex- 
í Tats on ee be ne eee 1U four months after 
AN law Hele G. Boren, and HE hofnan tuberct- admission virtually no patients had con- 
aes Eade ge in the co duct of this $ udy verted; at five- to eight-month follow-up; 
My ow at the University of Texas: 
199 
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over two-thirds had converted; and at the 
nine- to twelve-month follow-up, virtually all 
patients had converted. The highly selected 
nature of the present sample, as well as the 
potent effect of chemotherapy on the criterion 
should be carefully considered in generalizing 
the results of this study to the general popu- 
lation of tuberculous patients. 

The 32 patients that converted within five 
to eight months were designated the fast re- 
covery group. The 14 patients that did not 
convert within five to eight months were 
designated the slow recovery group. There 
was no statistically significant difference be- 
tween the fast recovery group and the slow 
recovery group in age, race, previous bed- 
rest treatment, or stage of illness (i.e., mini- 
mal, moderate, far advanced). All subjects 
received chemotherapy during the eight- 
month period under study. 

Measurement of behavior in the hospital. 
The ward behavior of each patient was rated 
on a 64-item rating scale independently by 
two aides and two nurses who ha 
attended the patient for several mo 
to the rating. Items representing th 
of behavior were selected on a rati 
from the Pool of items: 


d usually 
nths prior 
ree classes 
onal basis 
(a) 14 items con- 
gulations, e.g., stay- 


3A complete set of the measuring instruments (ex- 
cept for TAT), with scoring instructions, has been 
deposited with the American Documentati 3 
I Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C, remitting 
in advance $1.25 for photoprints or $1.25 for micro- 
film. Make checks payable to Chief, Photoduplica- 
tion Service, Library of Congress, 


L. J. Moran, G. W. Fairweather, S. Fisher, and R. B. Morton 


score on any subscale was the sum of a 
scores for the items comprising that ome. 
Measurement of attitudes toward i a 
pital environment. The attitude pet o 
sisted of items representing three class A 
attitudes, selected on a rational basis ome 
pool of 45 items: (a) 10 items Ee oe 
ward regulations, (b) 14 items ao other 
personnel, and (c) 4 items cae e “ 
patients. Items were couched in oe up- 
statements, e.g., “If I had a little $ » The 
time I would get well just as quick A were 
statement was read to the patient, following 
instructed to respond in one of the Iy agree, 
four ways: strongly agree, moderately 25 
strongly disagree, moderately disagree. 
In the construction of the scale, gaan 
judgment was made as to whether ba cou 
or disagreement with a particular ite The Te 
be considered least or most acon score 
Sponse of the patient to each item ers o 
0, 1, 2, or 3, depending on the in P nality: 
the attitude and its adaptive direnae di- 
Thus, an item considered adaptive “followin 
rection of agreement received the A 


3 Ss ately dis” 
scores: strongly disagree = 0, moder: strong! 


prior i 


= 2, 
agree = 1, moderately agree ale was 
agree = 3. The score for any a colle 
the sum of the scores for the items 


ing that subscale. , + cement 
u easurement of prehospital life ale 
This information was obtained by intervie 
Structured interviews. The total l con- 
schedule concerning past life sajum items, 
sisted of 132 items. From this pool sericte : 
three rational subscales were ig institu- 
(a) 7 items concerning response tO arrests, 
tional control, e.g., scliool attendens items 
military disciplinary actions, (b) relations, 
concerning general interpersonal referre 
€.g., fights, number of close friends, Fig pas 
activities, and (c) 12 items conen Eri, or- 
life achievement, e.g., school R rank, 
anizational leadership, gain in mili 
gain in occupational level. it 
Each possible response ta an least 
ranked on an a priori basis noni ossible 
most adaptive. The score for oe P sition 
response to an item was its ran Pin g 
with the least adaptive response rec n ite 
score of zero. Thus, the response to pe 
with two response possibilities rece 


e was 
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score of zero or one; an item with three re- 
sponse possibilities received scores of zero, 
one, or two, and so on through the items. 

To prevent items with the greatest number 
of response possibilities from unduly influ- 
encing the total scale score, responses to each 
item were rescored on a scale from zero to 
nine. Thus, an item with two responses di- 
vided the zero-to-nine scale into three equal 
units and the two alternatives received scores 
of 3 and 6. A three-response item divided the 
zero-to-nine scale into four equal units and 
the three alternatives received scores of 2.3, 
4.5, and 6.7, respectively. All items on the 
Past life adjustment scale were so rescored. 
Any subscale score was the sum of the items 
comprising that scale. 

Measurement of fantasy productions. Stories 
to ten TAT pictures were obtained from 38 of 
the 46 patients. The test was administered in- 
dividually, with cards in the following se- 
quence: 1, 2, 4, 12M, 8BM, 6BM, 17BM, 
18BM, 6GF, 7BM. These protocols were 
Scored by Seymour Fisher in a blind manner, 
Le., without knowledge of the individual pa- 
tients, of the criterion group into which any 
Patient fell, or of the total number of cases 
in either of the criterion groups. Each proto- 
Col was scored in the following four ways. 


ae Extent of hostile fantasy was judged by the 
as Mber of instances in which a person was described 
in mtentionally injuring, harming, deceiving, block- 
on T inflicting any kind of damage to another per- 
serip tility was scored even when the act was de- 
oficiat as justified or as being carried out by an 
Sco al agent, eg, policeman. Hostility was not 
red when the damaging act was “accidental” or 
dide to abstract forces of nature. Interjudge rank- 
r reliability, based on ten independently scored 
Totocols was .92. 
arene 32Ue or weak vs. clear or strong depiction of 
o al figures was judged on the basis of stories 
tina 2, 6BM, and 7BM. Parental figures were 
A as clear or strong if the story described either 
in S In a clearly domineering or unfriendly role or 
Ures clearly favorable or friendly role. Parental fig- 
ere Were Scored as vague or weak if the parents 
Were described as inadequate or if the story ay 
Cation oe fragmentary or unclear to permit classifi- 
Teliab; in the clear or strong category. An ore 
talea Y of .81 on the dichotomous scores was 0b- 
on twenty independently scored protocols. 
ber gp Pitation fantasies were judged by the num- 
avin; instances in which a person was described as 
Work. high aspirations, engaging in unusually hard 
> attaining financial success, doing an excellent 
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job, being obligated to great effort, or attaining any 
laudable aim. The judgment of aspiration fantasy 
included statements of determination, special pur- 
pose, and the adoption of a purposeful, challenging 
attitude toward the world. An interscorer rank- 


order reliability of .62 was obtained on ten inde- 
pendently scored protocols. 


4. Fantasies of inactivity were judged by the in- 
poe of all explicit references to sleeping, day- 

g or dreaming, passively giving up, being in 
a dazed state of consciousness, being pitifully inade- 
quate to a task, or being dreamily preoccupied with 
something distant from the present situation, Lack 
ot inactive fantasy received the highest score. Rank- 
order reliability of scoring, based on ten independ- 
ently scored protocols was .79. 

Statistical treatment. It was hypothesized 
that rapid improvement should be correlated 
positively with high scores on each of the 
psychological variables. This hypothesis was 
tested by biserial correlation except for the 
fantasy variables which, because of dichoto- 
mous scoring, were tested by tetrachoric cor- 
relation. 

The variables were then intercorrelated and 
a smaller matrix derived by means of a clus- 
ter analysis of the total matrix. This derived 
matrix provides the cluster of variables that 
have a positive correlation with the criterion 
variable and which also are all positively cor- 
related with each other. 

It is necessary at this point to anticipate 
the results in order to account for the pres- 
ence of an additional variable. The discovery 
of a significant relationship between the TAT 
story depiction of vague or weak parental fig- 
ures and the patient’s fast recovery led to 
speculation about the absence of parental fig- 
ures in the early life of such patients. This 
additional post hoc variable, complete ab- 
sence (death, divorce, or separation) of one 
or both parents before the patient was ten 
year old, was therefore included. 


Results 


In Table 1 is shown the correlation of each 
variable with the criterion of fast recovery. 
The probability that this distribution of cor- 
relations could have occurred by chance is 
p < .01. As indicated in Table 1, conformity 
to hospital regulations and good relations 
with personnel were significantly correlated 
with fast recovery, 38 and .55, respectively. 
Good relations with other patients also 
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Table 1 


Correlation Between Fast Recovery and Selected 
Psychological Variables 


Psychological variables Correlation 
Behavior toward regulations E. 
Behavior toward personnel 55% 
Behavior toward patients .29 
Attitude toward regulations =11 
Attitude toward personnel -10 
Attitude toward patients —.02 
Past behavior toward control 01 
Past behavior toward peers 14 
Past behavioral achievement —.18 
Fantasy hostility .44* 
Fantasy clear parent —.61 
Fantasy aspirations 25 


Fantasy (lack of) inactivity 35 
Loss of real parent 


58** 
*p <.05 thatr < 00. 

** b <.01 that r = 00, 

Dd <.001 that r < .00, 


showed a correlation of .29 with rapid im- 
Provement, which Statistically was not sig- 
nificantly greater than zero. 

Neither the attitude 
measures of 
Significantly 

The measu 


variable, 
both parents be. 
ts old. This loss- 
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of-parent variable was significantly corre- 
lated .58 with fast recovery. on 

Table 2 presents an empirically day 
cluster of those variables that were post 
correlated with fast recovery and were a 
correlated positively with each other. For on 
venience of the reader, fantasy-clear-pare' : 
in Table 1 has been changed to ron 
vague-parent in Table 2, and the signs 
versed. 


Discussion 


When the results of this study are a 
collectively, it would appear thar vans arly 
in rate of recovery from tuberculosis is e, 
associated with observed adaptive be ‘vit 
on the ward, associated to some degree ex- 
measures of fantasy, and unrelated eao 
pressed attitudes or to prehospital beha 
as measured. + og jn 

The cluster of positive intercorrelations g 
Table 2 furnishes what might be Tiea 
an empirically derived “syndrome, compl? 
terizing those patients in the present i char- 
who recovered most rapidly. A centen pale 
acteristic of this syndrome might be la te- 
“docile amiability.” The egiraordihay an 
strictions imposed as conditions of Bi rela- 
are obligingly respected; interpersona these 
tions with the personnel who admi a 
restrictions are generally very cordia ' wi 
there is some indication that relations Hos- 
other patients are better than average. io 
tility, when it appears, is more niey over 
evident in fantasy material than in the 
behavior of the patient. n- 

The last two aie in the enn nA 
courage speculation about the etiologic 


Table 2 
Derived Matrix of Positively Intercorrelated Variables 
Variables 1 2 3 4 5 6 7 
1. Fast recovery 
2. Behavior toward regulations .38* 
3. Behavior toward personnel .55** .49** 
4. Behavior toward peers .29 .66** 63** 
5. Fantasy hostility 44 17 ‘04 05 
6. Fantasy vague parent .61* 13 “22 01 19 
7. Loss of real parent .58* 04 22 48* 57* 35 


*p <.05 that r = .00, 
** p <.01 that r = 00. 


en, SE 
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nificance of parental identification in the de- 
velopment of “docile amiability.” Both the 
lack of clear representation of parental fig- 
ures in the TAT stories and the absence of 
one or both parents during the patient’s child- 
hood are suggestive of limited identification 
with parental figures. 

The reader is free to place any interpreta- 
tion he chooses on these strictly empirical 
data. We entertain the hypothesis that it is 
the strongly identified American male that is 
likely to show slower recovery from tubercu- 
losis. He is the one most likely to obstruct 
treatment by rebelling actively against the 
rigidly enforced dependency which is a con- 
dition of treatment for tuberculosis. This hy- 
pothesis receives some support from Witt- 
kower’s finding that the tuberculosis cases 
with poorest prognosis were those whose 
“lives were governed by conscious and un- 
Conscious attempts to emulate, please, or 
Placate their ambitious, driving and, hence, 
ambivalently regarded parents whose image 
had become an integral part of their person- 
ality structure. . . . Such persons take badly 
to hospitalization. . . . Their pent-up ten- 
Sion may be discharged in general restless- 
hess and/or undesirable activities at the hos- 
pital” (4, p. 211). 


Summary 


Rate of recovery from tuberculosis was 
estimated for 46 patients by the amount of 
time required for bacteriological conversion 
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to occur. This criterion was then correlated 
with four classes of psychological measures: 
(a) behavior on the ward, (b) attitudes to- 
ward the hospital environment, (c) life his- 
tory, and (d) responses to ten TAT cards. 

Variability in rate of recovery from tu- 
berculosis was found to be associated with 
adaptive behavior on the ward, associated to 
some degree with measures of fantasy, and 
unrelated to expressed attitudes or to pre- 
hospital behavior, as measured. A cluster of 
positive correlations was then derived from 
the total matrix, and hypotheses offered con- 
cerning personality “syndromes” associated 
with fast recovery and slow recovery from 
tuberculosis. 


Received September 12, 1955. 
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1 
Flexor-Extensor Movement on the Rorschach 


Mitchell Wetherhorn 
Cambridge (Minnesota) State Hospitai 


This study attempted to validate current 
interpretations of flexor and extensor move- 
ment responses on the Rorschach test. It has 
been suggested that extensor movement is a 
correlate of aggressive, masculine, dominance 
striving, and flexor movement is a correlate 
of passive, submissive, feminine striving. In 
order to test this hypothesis, a series of spe- 
cial movement plates was designed, consist- 
ing of two human figures in opposition. Spe- 
cial plates were needed to elicit large num- 
bers of movement responses since the average 
number of responses classifiable as flexor or 
extensor movement on the regulation Ror- 
schach protocol is small. 


The problem, stated negatively, was that 
flexor-extensor movement is not a 
of ascendancy- 
femininity. 

The Ss were under 


measure 
submission nor masculinity- 


graduate college students 
enrolled in general psychology. The group 
comprised 47 females and 33 males. Each $ 
was administered the M Í scale of the MMPI, 


1 An extended report of this study may be ob- 
tained without charge from Mitchell Wetherhorn, 
Cambridge State Hospital, Cambridge, Minnesota, 
or for a fee from the American Documentation In- 
stitute. Order Document No. 4828 from ADI Aux- 
iliary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D, C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress, 


the A-S Reaction Study, and the special move 
ment plates. sor 

Female Ss produced significantly ya 
movement responses on the SMP t as 
the male Ss (¿= 2.45; p= < eat 
did not produce significantly mo E $ 
responses than did the females He as fol- 
= n.s.). The female scores correlate 06, B- 
lows: A-S and flexor movement — d flexor 
and extensor movement + .10, Mf move- 
movement — .07, and Mf and ee as fol- 
ment + .02. Male scores correlate 07 
lows: A-S and flexor movement er flexor 
and extensor movement — 19, Mf a ovement 
movement — .25, Mf and extensor = signifi- 
+ .20. None of the correlations were 
cant. 

In conclusion, it would app 
extensor movement continuum does T aig 
ure the same dimensions of pērsonaliiy : 
A-S Study or the Mf scale of the stu 
There is need for further validation tions- 
of flexor-extensor movement a 
Perhaps a projective technique ot than 
SMP taps a deeper level of persona ha cor- 
questionnaires, hence the lack of hig be ob- 
relations. Nevertheless, caution should ae 
Served in utilizing flexor-extensor move 
as a measure of the variables studied. 


a 
ear, a flexo 


eas- 
es not m 
A the 


Brief Report. 
Received February 17, 1956. 
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The Goal-Spurt Hypothesis and the Rorschach Test’ 


Louis J. Maradie 


Dade County Board of Public Instruction, Miami, Florida 


wie possible relationship between color and 
io ulus objects and its effects upon percep- 

n have been the subject of many investi- 
cane In discussing the influence of color 
Sede he subject’s perceptions to the stimulus 
"ilte > oschach stated that, “There is a defi- 
A o between the extent of motor 
dh and the number of responses influ- 
added y color perception.” He apologetically 
remaj that, “The causes of this correlation 

re to be discovered” (6). 

A the problem is the fact that 
hone there is little experimental evidence 
ih tis that the presence or absence of color 

a € stimulus figures is related to the num- 

nd oe of responses, clinically we 
Rifica at the color plates often do evoke sig- 
affectis responses indicative of the patient's 

Ive status. 

Specifically, this study is concerned with 
co Classical assumption that the presence of 
schach the standard VIII, IX, and X Ror- 
is reg Plates stimulates normal subjects and 

h Ponsible for the subsequent increase 1M 
Klo ne of responses to these cards. 

me er (3) uses the ratio of responses to 
ins VIII, IX, and X divided by the total 
nclu er of responses to Cards I through X 
is j sive, According to him, underproduction 

Ndicated when the obtained ratio 1S less 
the 30. Overproduction is indicated when 
Obtained ratio goes above .40 to .50. He 


i 


Faculty of 
f Kentucky 
of Philoso- 
atitude and 
the director 


4 
t eit of a dissertation presented to the 
E ean School of the University © 
Phy, rae? ae the Degree of Doctor 
®Dpreci, e writer wishes to express his gr 
9 rus to Dr. Richard L. Blanton, i 
Were sp issertation, whose suggestions and guidance 
18 als inestimable value. Grateful acknowledgment 
© made to Dr. Graham B. Dimmick and to Dr- 


Ha 

h 

mate hbn who made available some of the test 
rials, 


interprets these variables as functions of 
either the “stimulating” or “disturbing” ef- 
fects of color. 

Lazarus was among the first to subject the 
problem of the stimulus value of color to ex- 
perimentation (4). In comparing his subjects’ 
performance on the chromatic and achromatic 
inkblots, he found that the absence of color 
had little effect on the scoring categories when 
the protocols were evaluated. Using the same 
technique, Sappenfeld and Buker (7) found 
no significant differences in the number of 
responses evoked by Cards VIII, IX, and X 
which were either chromatic or achromatic. 

This author (5) circumvented the artifacts 
which arise by retesting the same subjects 
under different conditions. Ten distinct sys- 
tematically randomized sequential orders of 
standard Rorschach plates in a latin-square 
design were individually administered to his 
subjects. He found that irrespective of the 
particular sequential order of the cards, the 
position of the cards in the series was of more 
importance with later-appearing cards evok- 
ing more responses than earlier-appearing 
cards. It was not definitely shown that color 
did not also have some effect, since this vari- 
able was not studied by the use of achromatic 
test plates. 

Although the above-mentioned studies (4, 
5, 7) have conclusively demonstrated that an 
increment in productivity is not inextricably 
related to the presence or absence of color, 
they have neither stimulated a refashioning 
of the classical assumptions nor have they of- 
fered acceptable explanations for the in- 
creased productivity phenomenon. 


Procedure 


Eighty females, who were enrolled as stu- 
dents in two nurses’ training schools in Louis- 
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ville, Kentucky, volunteered to act as sub- 
jects (Ss). They ranged in age from 17 to 35 
years with a median chronological age of 18. 
All Ss were Rorschach-naive and were assured 
that the results of their performances would 
be kept confidential. They were individually 
tested within a two-month interval. 

Both standard and achromatic Rorschach 
plates were used in this study. The achromatic 
figures, identical in structure and size to the 
standard plates, were printed in black ink 
only. Verlag Hans Huber of Bern, Switzer- 
land, produced both series of figures, but the 
achromatic figures were mounted by the au- 
thor. 

The work tasks were three in number. 


The Digit Symbol task is a visual-motor associa- 
tion task which involves the substitution of three 
different numbers—2, 4, and 6—under the appro- 
priate symbol—%, #, and &. Ten 52- by 8-inch 
cards, with 54 substitutions to be made on each, 
were presented to each of the Ss, No symbol fol- 
lowed itself and each symbol was present 18 times 
on each card. 

The Successive Addition task, a modification of 
Hahn’s KRHH Test, is a more complex visual-motor 
task. Ten 5- by 7-inch cards, each composed of 5 
columns of 11 one-digit numbers, were Presented to 
each S. By successively adding each overlapping pair 
of numbers down each of the five columns, 50 sums 
could be calculated on each card, 


(Green, Red, 
ge) printed incongruously in 
Printed in blue, red, 
printed in green, black, 


same row; equal numbers of 
printed on each card. 


Every card in each of the three work tasks 
was unique, thus minimizing the Possibility of 
learning from trial to trial. Each card of each 
work task had an equal number of operations 
requiring approximately a total time of one 
minute per card to complete. 

With demonstration cards 
actual cards of each of the three work-task 
cards, practice periods were given to each § 
in order to minimize any learning effects, One 


identical to the 
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minute of practice on both the Color Neier 
and Successive Additions tasks was give i 
Because of the association learning involve 
on the Digit-Symbol task, two minutes 
ractice were allowed. z 
i In order to determine the effect of arieni 
tion toward the goal on productivity, as a 
ured by responses on the Rorschach Tes aot 
time scores on the work tasks, m eh 
groups were designated. Half of po oe a 
posed the “Goal-Oriented” group an 
mainder, the “Goal-Disguised” group. 


pen © c- 
Those in the Goal-Oriented group ene ere 
tions which indicated the actual number l) which 
tions (Rorschach cards or work-task ing A or” 
they would be called upon to perform. those sug- 
schach test instructions to these Ss were of cards 
gested by Beck (1) in which the number Bie ad- 
the S will receive is clearly specified. They 


ae e wor 
monished not to make any eo T po em- 
tasks by attempting to work rapidly. norma: 


phasized that they should work at their own 
and comfortable rate of speed. , : 
To further insure a set for goal a ol 
stacks of ten Rorschach cards and the axes num- 
cards of each of the work tasks, approp ble to the 
bered on the reverse side of each, were Sard testing 
S and kept before him during the en 
eriod. r to & 
P The Goal-Disguised group was sdice and 
more trying procedure in that its Wri unstruc- 
Rorschach test instructions were complete "The Ror- 
tured as to orientation toward the goal. Iso those 
schach test instructions to these Ss ht of the 
suggested by Beck except for the sibat is Ss did 
word series in place of the word ten. id be pre- 
not know the number of cards which wou and rate 
sented. The admonition concerning ee Goal-Ori- 
of speed was identical to that given the i 
ented gri i wi 
ype Ss in this group were confronter ore 
a stack of twenty Rorschach cards en that they 
them. Nothing was communicated to a all. 
Would not be expected to respond to t Rorschach 
the case of the remaining Ss, the ten ax: i 
Plates were hidden from view under a t a time 
examiner’s side and were presented one ene ried out 
The two disguise techniques were also ately half 
with alternate work tasks. With ult 
the Ss, two of the three work tasks were 
the third disguised in the stack of twenty diseuise 
Ss were presented two of the work ae hidden at 
in the stack of twenty and the third tas 


the examiner’s side. m 
]-D15- 


In both the Goal-Oriented and oe roe 
guised groups, half of the Ss in ca alf the 
received the standard plates and ting t 
achromatic plates. Instead of presen 


the 


— > 
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ten cards in their usual order from I through 
X, a 10 by 10 latin square was constructed 
(5). Ten distinct sequential orders were ar- 
ranged in which each card preceded and fol- 
lowed every other card just once, and each 
card appeared once in each column and once 
in each row. To each of these discrete orders, 
an S was randomly assigned and presented 
with the plates, either standard or achromatic, 
peculiar to that order. The same latin square 
was replicated seven times by the random as- 
signment of additional Ss to each of the ten 
orders of presentation. Eight Ss responded to 
each of the ten dissimilar orders of presenta- 
tion. 

In both Goal-Oriented and Goal-Disguised 
groups, half the Ss were presented the Ror- 
schach test prior to the work tasks, while for 
the other half, the work tasks were followed 
by the Rorschach test. 

Both the Rorschach test scores (number of 
responses per card) and the work-task scores 
(number of seconds per card) were treated 
mathematically by the analysis-of-variance 
technique, followed by ¢ tests when appro- 
Priate, 

The Rorschach Goal-Spurt ratio is com- 
Posed of the number of responses to the cards 
ìn positions eight, nine, and ten divided by 
the total number of responses to the cards in 
Positions one through ten. 

The work-task Goal-Spurt ratio is com- 
Posed of the number of seconds on cards 
eight, nine, and ten divided by the number 
of seconds on cards one through ten. A ratio 
Was calculated for each of the three work 
asks and averaged into a single ratio. 

It was then determined whether an incre- 
Ment in a particular S’s productivity on the 
Work tasks, as demonstrated by a decline in 
wt time scores, was related to an increment 


M her productivity on the Rorschach, as 
the number 


€monstrated by an increase in 

er responses. Each individual was ranked 
On the basis of the extent of her Rorschach 
th average work-task Goal-Spurt ratios and 
a € correlation determined by the rank-differ- 
nce method. 


Results 


$ Before combining the data from the tont 
Parate latin squares of the “Goal-Oriented 
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Table 1 
Oriented Group Analysis of Variance Results 
Mean 
Independent observations: df square F 
Order of presentation 9 14.74 1.35 
Residual between individuals 
(error) 30 10.92 
Total between individuals 39 
Mean 
Correlated observations: df square F 
Cards 9 16.82 12.84** 
Positions 9 21.51 16.42** 
Residual from latin square T2 1.32 1.01 
Residual within individuals 270 1.31 
Total within individuals 360 
Total 399 


#* Significant at 1 per cent level. 


group and the four of the Goal-Disguised 
group, they were tested for homogeneity of 
total variance by means of Bartlett’s test (2). 
The resulting chi square values of 6.16 and 
5.58 were not significant and offered no evi- 
dence against the hypothesis of random sam- 
pling from a common population. 

After combining the data from the separate 
latin squares of the Goal-Oriented group it 
was further ascertained that differences in 
productivity between the sequences (or pairs 
of Ss responding to the particular order in the 
latin square) were not significantly different. 


Table 2 


Disguised Group Analysis of Variance Results 


Mean 
Independent observations: df square F 
Order of presentation 9 605 46 
Residual between individuals 

(error) 13.21 

Total between individuals 39 

Mean 
Correlated observations: df square F 
Cards 9 15.00 12.00** 
Positions 9 2.35 1.72 
Residual from latin square 72 144 1.15 
Residual within individuals 270 1.25 
Total within individuals 360 
Total 399 


** Significant at 1 per cent level. 
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Table 3 


Aggregate Sums of Responses to 
Rorschach Test Cards 


Standard Achromatic 
Cards Cards Totals 
Goal Disguised 528 515 1,043 
Goal Oriented 579 572 1,151 
Totals 1,107 1,087 2,194 


The insignificant F value of 1.35 in Table 1 
demonstrates this fact. Similarly, there were 
no significant differences between sequences in 
the Goal-Disguised group as the F value of 
-46 in Table 2 indicates, 

Table 3 reveals that total productivity in 
the Goal-Oriented group was slightly greater 
than productivity in the Goal-Disguised group 
although this difference did not meet statisti- 
cal significance (¢ = -63). The factor of non- 
orientation to a goal may have accounted for 
the smaller number of responses, 

Productivity on the achromatic plates was 
not significantly greater than on the standard 
plates (¢= 31). This comparison is also 


The Productiveness of the Ss in the Goal- 
Oriented group was greater in the later se- 


sponses by positions against the residual mean 
it was found that 
(16.42) is highly 
significant for 9 and 270 degrees of freedom 
(Table 1). 

In the Goal-Disguised group, the increment 
in productivity did not appear in the later se- 
quential positions. In fact, there was a rela- 
tive decrement in these later positions. The 
mean number of responses to the first seven 
positions was 53.8 while that of the last three 
positions was 48.2. The ¢ value calculated for 
the difference between these means was 1.06 
which does not reach statistical significance, 
This is also demonstrated by the insignificant 
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F value (1.72) obtained between the wis 
square for total responses by positions api 
the residual mean square within individual 

Table 2). 

: fees major factor of interest was 
effect of the cards themselves. When bet i 
for significance against the residual ie 
Squares, the mean squares for cards Goa 
found to be highly significant. In the ai 
Oriented group the obtained F tane Dis- 
12.84 (Table 1) and that of the yor a 
guised group was 12.00 (Table 2). Bo oat 
these values were significant at the 1 Pr ard 
level for 9 and 270 degrees of freedom es 
X, in contrast to Cards VIII and IX ‘ard 
are also endowed with color in the a 
plates, was by far the most provon fact 
the series. Of special importance is t 


š was 
that Card X of the achromatic oe ‘= 
similarly the most provocative 0 ate that 


ries. These findings clearly gemon 
neither the presence or absence of co ae 
the factor of goal orientation, accoun andy 
Card X’s evocative properties in Se bad 
It is likely that the unique quality of val fac- 
is its configuration and this is the cruci 
tor facilitating the Ss responsiveness. + fol 
Whether the work tasks preceded 0 aie 
lowed the Rorschach was not related re her 
differences in Rorschach productivity in ise 
the Goal-Oriented or the Con D is 
group as indicated by the respective 
of .13 and .49. ch 
In the Goal-Disguised group, Roro 
productivity was not affected aimen E 
(F = .80) by hiding the Rorschac ‘Git. 
from view or presenting them in a § 
twenty. al- 
Each of the three work tasks in te he 
Oriented group was tested separately h none 
analysis-of-variance technique. ee point 
of the obtained F values approached t incre- 
of statistical significance, there es ap- 
ments in productivity as the goal ri age 
Proached. This increment began to oe Digit’ 
the ninth positions (trials) of the task 
Symbol and Successive Additions wo Nan 
and in the eighth position of the Color 
ing task. _Dis- 
The three work tasks in the Gon 
guised group were also tested separ though 
the analysis-of-variance technique. signif 
none of the obtained F values were 


nor 


The Goal-Spurt Hypothesis and the Rorschach Test 
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Table 4 
Values of z for the First Seven Versus the Last Three Positions for Rorschach and Work Tasks 


Goal Goal 
oriented $ disguised ? 
Rorschach 3.921 01<p<.001 1.063 50<p<.10 
Digit Symbol 1.909 A0<p<.05 .206 90<p<.50 
Color Naming 2.233 10<p<.05 214 .90<p<.50 
Successive Additions 2.216 A10<p<.05 469 90<p<.50 


cant in any ‘of the work tasks, there were 
decrements in productivity in the later trials 
of all tasks. 

The values of ¢ for the first seven vs. the 
last three positions for the Rorschach test 
and work tasks are shown in Table 4. 

The Goal-Spurt ratios were determined for 
each S’s Rorschach test performance and work- 
task performance. They were then ranked in 
their order of magnitude. , 

In the Goal-Oriented group, the correlation 
between Rorschach and work-task Goal Spurts 
for those Ss who received the standard Ror- 
schach plates was .572. This was significant 
at the .01 level. The correlation between Goal 
Spurts of the Ss who received the achromatic 
Rorschach plates and the work tasks was .477. 

his was significant at the .05 level. , 

In the Goal-Disguised group, the relation- 
ship between Goal Spurts was more erratic. 
The correlation coefficient between Goal 
Spurts in the standard Rorschach plates and 
the work tasks was — .024. For those Ss re- 
ceiving the achromatic plates and the work 
tasks, the coefficient was .098. Neither was 
Significant. 


Discussion 


Rather than account for the increment in 
productivity in the all-color cards (Cards 
VIII, IX, and X) on the assumption of “af- 
fectivity” in response to color, the following 
interpretation seems more appropriate: 

It is assumed that most Ss initially in- 
terpret the Rorschach testing procedure as 
threatening, or at best, challenging (8). This 
may be a function of various factors such as 
the fact that the S is being timed, that she 
does not know how many or how few “things” 
she should see, or what “things” she should or 
should not see. The fact that it is a “mental” 
test which might expose her inadequacies may 


be anxiety-arousing. The fact that the large 
number of cards before her will involve much 
time and energy expenditure may in itself be 
resistance-arousing. As the S soon learns that 
any and all of her responses are reacted to 
unemotionally in a neutral, accepting atmos- 
phere, she becomes more comfortable and the 
number of her responses may increase and 
then remain fairly constant. As she ap- 
proaches the end of the seriés of test cards, 
she may feel relieved that she is about to 
complete the task. Along with this comes the 
awareness that the last cards provide the final 
means for demonstrating her ability as ex- 
emplified by the number of her responses. It 
follows that the S’s goal is simultaneously to 
produce more responses and to remove herself 
from the situation. The valence of the incen- 
tive is dependent upon her interpretation of 
the situation and the strength of her reac- 
tions to it. The extent of the increment or 
decrement in responses at the terminal point 
is, then, a reflection of the S’s evaluation of 
goal attainment and her ability to react and 
compensate accordingly. Since the test in- 
volves the circumvention of barriers (stimu- 
lus plates) between the S and the visible goal 
(completion of the task), the reaction to the 
perceived goal should have characteristics 
similar to that seen in learning situations 
(Goal Gradient Phenomena) and in work 
situations (End Spurt). The increment or 
decrement in responses can be measured by 
the number of responses to Cards VIII, IX, 
and X divided by the total number of re- 
sponses to Cards I through X. This ratio is 
interpreted as an expression of the “Goal 
Spurt.” 


Summary 


The purpose of this study was to determine 
the effect of knowledge of a goal upon pro- 
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ductivity in the Rorschach test and in a se- 
ries of mental work tasks. The data were ob- 
tained from eighty Rorschach-naive student 
nurses. They were randomly assigned to a 
Goal-Oriented group, which was informed of 
the number of trials in each task, and a Goal- 
Disguised group in which no information rela- 
tive to the number of trials was communi- 
cated. 

Equal numbers of Ss in both the Goal-Ori- 
ented and Goal-Disguised groups were pre- 
sented with either standard or achromatic 
Rorschach plates. Each series of ten test 
plates was drawn from a predetermined latin 
square in which the plates were arranged into 
ten distinct systematically randomized se- 
quential orders of presentation. In this man- 
ner each plate appeared in all positions and 
preceded and followed every other plate an 
equal number of times. 

Three mental work tasks were also admin- 
istered to each S in either the Goal-Oriented 
or Goal-Disguised condition. The ten trials 
(cards) of each work task provided a means 
of comparison between Productivity in any 
of the ten trials (positions) of the work tasks 
or the ten trials (cards) of the Rorschach 
test. 

The Goal-Spurt ratio was defined as the 
ratio between productivity in work-task or 
Rorschach test positions eight, nine, and ten 
divided by productivity in Positions one 
through ten. Ratios were calculated for each 
individual's Rorschach 


Plates produc- 


tlier-appearing 
ones. 


2. In both the Goal-Oriented and Goal- 
Disguised groups, irrespective of the Presence 
or absence of color, and independent of their 
orders of sequential relationships, the plates 
themselves differed in the number of 


responses 
elicited. Card X, because of its unique con- 
figuration, evoked more responses than any 


other. 
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3. In the Goal-Oriented group there wasia 
significant relationship between each S's =i 
schach and work-task Goal-Spurt ratios. T 
relationship did not exist in the Goal-D! 
guised group. 
ği Thus, it 5 shown that there is a sm 
positional effect present in both the Ki 
schach test and a selected group of eet 
motor perceptual tasks. This effect is aem F 
strated only when the Ss are made eee 
the number of trials necessary to comp ta- 
the task. In the orthodox order of ya | 
tion of the Rorschach plates, Card X, y os 
ture of its unique configurational ane 
and its final position in the series, faci 
an increment in responsiveness. | so cigs: ah 

For these reasons, the “affective” ra VII, 
the increment in productivity on Cards pasis 
IX, and X, is better explained on e 
of the Goal-Spurt formulation. This i dem- 
sis is more parsimonious, is objective Y ie 
onstrable, is based upon studies er work 
with the laws of learning and mente irie 
and, quite apart form the various Ten 
attributable to color, explains the La cards: 
in productivity in the later-appearing 
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Perceptual Judgment and Associative Learning 
Ability of Schizophrenics and Nonpsychotics* 


Jay L. Chambers 
University of Kentucky °? 


Kasanin (5) and others have tried to ana- 
lyze the thought processes of schizophrenics. 
Many of their observations suggested a lack 
of critical judgment in schizophrenics’ think- 
ing, particularly for complex problems such 
as planning for the future. Whether schizo- 
phrenics would also demonstrate impairment 
or simple judgment problems was the pri- 
mary concern of this study. 

A secondary aim was to determine if schizo- 
phrenic intellectual impairment also affected 
learning capacity. Several studies have re- 
Ported little or no impairment of learning 
ability among schizophrenics but the controls 
in most of these researches were lacking or 
inadequate, making the results inconclusive 
(1, 2, 3, 4). Therefore, a testing of associa- 
tive learning among schizophrenics was in- 
cluded in the study. A problem involving both 
learning and judgment was added in the 
eventuality that a task combining these proc- 
esses would be necessary to reveal an impair- 
ment in schizophrenic thinking. 

The degree of complexity of a judgment 
was considered, for the purposes of this in- 
vestigation, to depend upon the number of 
variables involved in a judgment. For exam- 
ple, a simple judgment would involve only 
one variable such as the use of IQ alone in 
judging students’ academic potential. A more 
complex judgment would require the com- 


1 Based upon a Ph.D. dissertation performed at 
the University of Kentucky. The writer wishes to 
express appreciation to Drs. James S. Calvin, Gra- 
ham B. Dimmick, Martin M. White, R. S. Allen, 
Ernest Meyers, and A. Dudley Roberts for assist- 
ance on the thesis. The writer is also indebted to the 
Lexington and Louisville Veterans Administration 
Hospitals, where the subjects were obtained. 


2 Now at Muskingum College. 


bining of several variables for the judgment, 
as in predicting students’ academic ability on 
the basis of the combined variables of intel- 
ligence, motivation, educational background, 
etc. 

Perceptual judgments of spatial dimensions 
(e.g. length, area, etc.) were selected for the 
judgment problems as they afforded objective 
criteria, neutral or impersonal stimuli, and 
represented a basic type of judgment problem 
practiced by all cultures and individuals. 

With these considerations in mind a pro- 
cedure was designed to determine, if possible, 
whether schizophrenics, as compared with 
nonpsychotics, would demonstrate (a) im- 
pairment in complex but not in simple judg- 
ment problems, (b) impairment in judgment 
but not in learning, and (c) impairment in a 
task combining both judgment and learning 
but not in either ability tested separately. 


Method 


In order to test the various hypotheses 
proposed, seven tasks were devised. Each in- 
volved the sorting of geometric designs into 
five categories. The designs were drawn in 
black ink on 21⁄4” X 314" white index cards 
and were presented by E, who held them up 
one at a time for S’s inspection and then 
placed them in the category chosen by S. In 
each task, the order of the designs was sys- 
tematically varied so that no patterning oc- 
curred. 

The perceptual judgment tasks were con- 
a y paar port | experimentation with 
see au Aay. Ue Io E dos 
criminating between calone G itheulty of dis- 
eaei e gradations of 

eld constant by maintaining 
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a constant ratio of increment between the 
gradations. 

Following are brief descriptions of the tasks, 
in order of their presentation. 


Task 1: Associative Learning 


This task required S to learn to sort five designs 
(a circle, a square, an “x,” a horizontal line, and a 
vertical line) into five Plain boxes. As there was 
little similarity between the designs, the task was a 
relatively “pure” learning problem with a minimum 
of discrimination required to differentiate the stimuli, 
Learning was by trial and error and after each choice 
E informed S of the correct box for the design. Each 
design was presented ten times in the task. 


Task 2: Simple Judgment of Density of Dots 


For this task $ was required to discriminate and 
sort five gradations of density of dots presented on 
the index cards. The gradations were numbered “1” 
through “5” in order from the least to most dense. 
The use of numbers provided an already learned 
order of symbols. To Provide an initial standard of 
judgment E showed S a set of the five gradations, 
The standard was then removed, representatives of 
the five gradations were Presented successively by E 
to S, and S was Tequired to judge each card for its 
Position in the series of gradations. Each gradation 
Was presented ten times in the task, 


Task 3: Simple Judgment of Area of Circles Com- 
bined With Associative Learning 


This task required S$ to judge five gradations of 
circles and to learn to refer 


were used for the rem; 
judgment was initially 
gradation was presente: 


Task 4: Simple Judgment of Degree of Angles 


Five gradations of degree of an 
this task. Task 4 did not ri 


ally the same as Task 4 ex- 


cept that five gradations of length of lines were used 


as stimuli. 


Task 6: Review of Tasks 3, 4, and 5 


Six trials for each gradation of 
lines were presented to renew experience with these 
stimuli, because the comple: 


9 x judgment task to follow 
depended on approximately equal familiarity with 
each type of stimulus. 

’ 


circles, angles, and 
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oe ari- 
Task 7: Complex Judgment Combining Three Vi 
ables 
tc abili com- 
This task was designed to test S's = F PEA 
bine or integrate three variables in making 


f was 
“plex judgment. For each trial (63 trials), $ 


$ irde, 
shown a card on which the three variables O 
an angle, and a line from the preceding Jia to 
tasks) were all presented. The S was ins! raderen 
consider all three variables in making a 2 a unit 
but was required to respond to the o in the 
by giving only one estimate of its post were given 
series of five gradations. No corrections (Part a) 
on this task. For the first fifteen trials ‘ito the 
the variables were in agreement with rhe remaining 
Position in the series represented. For t oppose 
48 trials (Part b), one of the cues was OP 
the other two. 


c. 

The total errors constituted the aei y 
score for each task. An error was de ttl 
the difference between the position of fie pi 
lus in the series and S’s judgment © agree- 
sition. For Task 7b, the two cues ee a 
ment were taken as the correct pos! 
the stimulus. 4 

For comparison of speed diffe 
number of seconds to complete eac 
recorded for each S. 


rences, 
h task was 


Subjects 


The Ss were all male veterans hav} r I 
in the armed forces during World v hos- 
later. All but four of the subjects Kentucky 
pitalized at either the Lexington, ns Ad 
or the Louisville, Kentucky Veer eet 
ministration Hospitals. The four See - 
ized veterans matched in amer Tee ' 
spects the hospitalized subjects. a 
The = se divided into two a i ke 
those psychotic at the time of tes the time 
(b) those who were not psychotic a having 
of testing and who had no record © atients 
been psychotic. All the psychotic Phrenic 
carried an official diagnosis of SNO at d 
reaction except one patient who late ic brain 
a mixed diagnosis including ciron a var 
syndrome. The nonpsychotics pe iy f 
riety of official diagnoses, the meen Sarati 
ing into either character disorder “oe sig- 
categories. The two groups did not Jligenc® 
nificantly with regard to age or inte 
Each group was composed of 30 Ss. js, the 

In addition to the official agmo ‘pasis 
Psychotic subjects were selected on a de- 
of the ward psychiatrist’s opinion that, 


ng bee? 


the 
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a ee 


Table 1 


Error Scores for Learning and Judgment Tasks 


Schizophrenic © Nonpsychotic 
(N=30) (V=30) 
Level of 
Type of task Mean SD Mean SD t Qn . 
Associative learning 
1. Symbols 54.2 22.2 55:1 20.2 Ay a 
Simple judgment 
2. Dots 490 18.2 30.2 5.7 35.31 w 
3. Circles 56.2 18.5 45.2 12.6 2.63 .02 
4. Angles 59.7 20.5 49.4 18.9 1.97 06 
5. Lines 51.9 22.6 37.3 15.0 2.89 01 
6. Review 104.3 12.6 76.1 31.0 3.00 ‘01 
Complex judgment 
Ta. {Circles 16.0 7.7 10.0 48 3.51 001 
Angles = 
7b. (Lines 37.0 14.5 18.7 15.7 4.59 001 


spite active psychosis, mental deterioration 
and incapacity was minimal. Only patients 
from active treatment wards were used. No 
patients undergoing electric shock treatment 
Were used. 


Results 


_ The data of Task 1, presented in Table 1, 
indicated no significant difference between 
schizophrenics and nonpsychotics for accu- 
racy of associative learning. The schizophren- 
ics were consistently poorer in accuracy for 


ever. These differences were significant at the 
02 level or better, with the exception of Task 
4 (simple judgment of degree of angle) where 
the difference attained a probability of .06. 
The data presented in Table 2 indicated 
that the schizophrenics were slower on all the 
tasks. These differences were significant at 
the .05 level or better with the exception of 
Task 7, where the differences did not attain 
significance. A trend toward decreasing sig- 
nificance for speed differences, as reflected by 
the size of #, may be noted as the tasks pro- 


all of the perceptual judgment tasks, how-  gressed in order of presentation. 
Table 2 
Time Scores in Seconds for Learning and Judgment Tasks 
Schizophrenic Nonpsychotic 
(W=30) (N=30) 
Level of 

Type of task Mean SD Mean SD t sig. 
Associative learning 

1. Symbols 334.5 195.2 248.2 84.6 2.18 05 
Simple judgment 

2. Dots 326.0 185.8 212.7 35.1 3.22 OL 

3. Circles 343.8 129.9 259.3 58.9 3.18 OL 

4. Angles 310.5 102.4 252.5 54.4 2.69 OL 

5. Lines 287.7 94.7 233.7 44.0 2.78 OL 

6. Review 531.7 172.0 449.2 91.6 2.27 05 
Complex judgment 

Ta. (Circles 92.0 62.2 70.5 18.7 1.78 10 

Angles 
Tb. (Lines 282.3 187.3 234.7 14.5 1.27 30 
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Discussion 


If accuracy is used as the criterion for 
learning and judgment ability, then the re- 
sults of this study support the previous evi- 
dence cited from the literature. Schizophren- 
ics showed no impairment of accuracy in 
learning, but were consistently less accurate 
than the nonpsychotics in the judgment 
tasks. In speed, however, the schizophrenics 
were slower on both learning and judgment 
tasks. 

The finding that schizophrenics were im- 
paired in accuracy of judgment but not in 
learning might be interpreted as due to dif- 
ferences in motivation rather than ability. 
Perhaps the schizophrenics were more mo- 
tivated at the beginning of the testing and 
thus performed more accurately on the learn- 
ing task than on the later judgment tasks. 
No consistent Preferences were expressed by 
either group for the type of task performed 
but further Tesearch, varying the order of 
Presentation of the tasks, would better test 
an interest or motivation influence. 


fore, there 
complexity 
cant variable for differentiating these two 
groups. 

An interesting aspect of the data was that 
schizophrenics and nonpsychotics were dif- 
ferentiated through the use of perceptual- 
type judgment problems. Clinical workers 
have long felt that schizophrenics revealed 
inadequacies in judgment of social situations 
and everyday life problems. Unfortunately, 
evaluation of such judgments is necessarily 
crude and unreliable. Tests of perceptual 
judgment of physical dimensions may be just 
as effective for diagnostic purposes and are 
more accurately and objectively evaluated. 

The significant difference between the groups 
for Task 2, which was primarily a judgment 
task and required little learning, indicates 
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that a combination of judgment and learning 
was not necessary to demonstrate impair- 
ment in schizophrenics. Apparently a judg- 
ment factor alone was sufficient to oer 
ate schizophrenics and nonpsychotics. Also 
the fact that the schizophrenics continea m 
be poorer in accuracy of judgment a a 
Task 3, where the “color names” had aen 
learned, offers further reason for rejecting 
this hypothesis. 


Summary 


A group of 30 well-preserved, but gerd 
psychotic, schizophrenic subjects were mi 
pared with an equal number of nonpa EAE 
subjects for performance on associative lea 
ing and perceptual judgment tasks. m 

The results tended to confirm other ie 
search indicating impairment in age one 
judgment without loss of accuracy in li 
ing. However, the schizophrenics by si 
cantly slower on both learning and judg 
tasks. , 

The finding that perceptual-type judgment 
tasks differentiated schizophrenics and nee 
psychotics may be used to develop rion 
and accurate judgment tests for diagn 
urposes. , k 
j A combined judgment and learning tas 
failed to disclose differences ong ins 
groups of any greater significance udg- 
obtained by tasks which emphasized J 
ment alone. 


was 
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Determination of Defense Mechanisms for 
Conflict Areas from Verbal Material’ 


Morton Wiener, Bruce Carpenter,” and Janeth T. Carpenter ° 
Central State Hospital, Indianapolis 


is ih was undertaken to develop cri- 
Betere. ERE from verbal material two 
prëssive Ses of defense mechanisms—re- 
egal efenses and sensitizing defenses. 
ier criteria seem to have application to 
study Pein of research. For example, a 
criteria t perceptual defense utilizing these 
by Ca o select subjects has been reported 
his e Wiener, and Carpenter (3). 
theres to a might also be used to study 
os i. in defense behavior as a consequence 
fanse a or for any research problem where 
koa mechanisms are to be determined 

Th erbal material. 
eons Ce of repression has been widely 
Suggest in the literature, and there are many 
meane as to the nature of repressive 
tlan oe For example, Maslow and Mit- 
ejection 2 p. 608) define repression as “the 
i os toe and shutting out of the awareness 
a actin pattern (thought, feeling, im- 
Shaffer ou in order to avoid distress”; 
“a failure i p 211) defines it objectively as 
EET o make a certain response, when 
pected to 1 are presented that might be ex- 
doles it invoke it”; Thorpe (10, p. 149) 
it as “the process by means of which 


1 This 
project E Aa carried out as part of a larger 
Clifford L, Wits permission and encouragement of 
tral State MET M.D., superintendent of Cen- 
made to Dr, <_< Grateful acknowledgement is 
for making his tida C. Josey of Butler University 
this study. The ents available to serve as Ss for 
Jones for Kor sees wish to thank Mr. Austin 
ing a draft of this a judge and for critically read- 
to Mr. Earl Furlow popon: Appreciation is expressed 
selection of the SoN tance in the preliminary 

$ s iteri 
nine psychologists who P A and to the other 
seminar. the criteria in a 

2 Now at Florida State University 


the individual defends himself against being 
confronted with unwelcome thoughts and d 
sires.” Similar definitions have been given 3 
others (4, P. 220; 11, p. 240). y 
us the concept of repressi e 

established. The concept of aOR 2 
defense mechanism has a much shorter hik- 
tory. Bruner and Postman (1, 2) used the 
term “perceptual sensitization” to describe 
the unexpectedly short perceptual reaction 
time of some Ss to “dangerous” stimuli. The 

postulated a selective vigilance on the part of 
an organism which is characterized by meet- 
ing the “dangerous” stimulus with utmost 
alertness and speed. The present authors de- 
fine sensitization as a heightened vigilance 
which operates when the environment sug- 
gests the presence of threatening hiateriel: 
the individual is sensitive to the conflictual 
stimulus but to decrease the anxiety aroused 
by it, he changes the significance of the stimu- 
lus (e.g. intellectualization, undoing, displace- 


ment, projection). 

The primary purpose 0 
termine whether a reliable crit 
tablished for determining repressive defenses 
and sensitizing defenses from verbal mate- 
rial. Secondarily, the question of whether 
there is a generalized defense which indi- 
viduals use for several areas of conflict or 


anxiety will be investigated. 
Method 


Subjects. One hundred forty undergradu- 
ates in a beginning psychology course made 
up the experimental sample. 

Procedure. A special sentence-completion 
blank was devised for use in determining de- 
fense mechanisms. The sentence-completion 


f this study is to de- 
erion can be es- 
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blank was self-administered by each S out- 
side of class. The instructions were: “Com- 
plete these sentences to express your real feel- 
ings. Try to do every one. Be sure to make a 
complete sentence.” The sentence completion 
blank consisted of the following twenty stems, 
mimeographed with triple spacing between 
stems: 


1. Sports are 11. Dating 

2. I don’t want to know 12. People who neck 
3. Dancing 13. It bothers me 

4. Reading is 14. I get mad 

5. I failed 15. I really feel 

6. There are 16. Men and women 
7. I resent 17. What annoys me 
8. I hate 18. I secretly 

9. Sex is 19. The birds 

10. Walking 20. Deep down I 


12, and 16) were 
designed to elicit sexual content. Five stems (Nos. 
7, 8, 13, 14, and 17) were designed to elicit content 


conflict, it was decided to score the sentence 
as for Sensitization to inadequacy 
also, 


In scoring the 


first discrimination attempted by the judges 
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characteristics and those with sensitization 
characteristics. The following criteria were 
used to score responses as repressive. Exam- 
ples are given in parentheses: 


TEE to 
a. The use of clichés. (I hate war; Sex is here 
stay.) A nos 
b. Denial of stimulus implication. (I hate 
body.) 
c. Avoidance of stimulus. (Z hate asparagus.) 
d. Blocking (no response). hate 
e. Distancing from personal involvement. (I 
to think of how cold it is in Creon) mee 0 
Í. Very limited generalizations. (It bo 
when someone pops gum in my ear.) conflictual 
8. Minimization of involvement in the REE 
activity. (Sex is something I won’t know 
Tm married.) Jity by auc 
h. Obligation, duty, imposed sine agen ould 
thority, (Dancing is something young peop 
learn.) fic- 
P f con 
i. Definitions which lead to avoi Ea js the 
tual connotations of the stimulus. (Da? 
movement of one’s fect.) sei op ideali- 
i. Moralization, romanticization, rp is to 
zation. (Sex is one of the gifts of God 
used and enjoyed as He wishes.) 
re 
5 aas to scor 
The following criteria were mad P 
the sentence-completion responses s in pr 
zation responses. Examples are giv 
rentheses: 


is 
lure. (Se 
a. Statement of inanediine in failure 
Something I’m very bashful about. an exams 
b. Rationalization. (J failed my Germ g 10° 


in, 

but it was because I was tired from worki in 
hard. ad 

C: aioa (It bothers me a tak 
the newspapers that the Communists 
Over another country.) seer 

d. Acting, then undoing or inhibiting. a 
brother, but only when he fights with i a 

e. Displacement or projection of fee Tie 
people. (It bothers me to hear people ma i 
another’s physical defect.) no con 

A Preoccupation, including elicitation i inapp! o” 
flictual response by a stimulus which J hate t 
priate for that particular content area. 
see two girls holding hands.) P others 

&. Projection of motives or feelings 5 i 
hate people who deliberately hurt others. jal. (Sex? 

h. Use of humor with conflictual nae too I” 
something I don’t know much about— 
nocent.) ii 

i. Qualification. (People who neck are all m 
they don’t do too much.) § 

j. Overreaction to stimulus. (Z kate people sigo 

k. Denial of importance. (Sex is over-€ 
in our society today.) 


a hate ™Y 
othet 
Ai of 


ht, 


4 
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Defense Mechanisms for Conflict Areas 


As a general scoring criterion, avoidance of 
the stimulus or denial of the activity implied 
in the stimulus was considered a repressive 
mechanism; denial of the importance or con- 
flictual nature of the activity was considered 
a sensitizing mechanism. 

There were eight possible judgments which 
could be made about each response. A re- 
Sponse could be scored: (a) without conflict; 
(5) hostility conflict—sensitizer; (c) hos- 
tility conflict—represser; (d) sex conflict— 
sensitizer; (e) sex conflict—represser; (f) 
adequacy conflict—sensitizer; (g) sensitizer 
response without designation of area of con- 
flict; or (4) represser response without desig- 
nation of area of conflict. 

Four clinical psychologists acted as judges. 

greement between judges was arbitrarily de- 
fined as at least three of the four judges mak- 
ing the same judgment about a response from 
the eight possible judgments. 

Each S’s response to each stem was typed 
On a separate card. All responses to each 
item were placed together for judging. Three 
Judges first independently scored all 2,100 
Critical items. The five neutral items were 
Not considered. Those items on which all 
three judges agreed were removed from the 
Set and the remaining items were scored in- 
dependently by a fourth judge. Those items 
which reached the agreement criterion were 
used to assign scores to each S. Items on 
which judges did not agree or which were 
judged as not indicative of conflict were not 
included in the scores. Each S was given a 
Represser-Sensitizer (R-S) score for sex and 
an R-S score for hostility. Each score was 
based on the number of responses in a par- 
ticular conflict area judged as sensitizing and 
as repressive. The number of repressive and 
sensitizing responses were combined by a 
formula (S — R + 5) into single score vari- 
able with scale values ranging from 0 to 11. 
A 0 score indicates consistent repressive de- 
fenses in an area. A score of 11 indicates con- 
sistent sensitizing defenses in an area. A score 
of 5 was obtained by Ss who had an equal 
number of repressive and sensitizing responses 
in an area. Each S was also given a general 
R-S score based on the number of responses 
judged as repressive or sensitizing without 
designation of any particular area of conflict. 
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The formula (S — R + 5) was used to obtain 
the general R-S score. Each S was given an 
Adequacy score; this score was the number of 
sentences in which an expression of inade- 
quacy was judged to have been elicited. 


Results 


Agreement between judges was obtained for 
72 per cent of the 2,100 sentences judged. Of 
the remaining 28 per cent, the judges split 
(with two judges making one judgment and 
two making another judgment) on 14 per 
cent of the items. The remaining 14 per cent 
showed less agreement than this. Examina- 
tion of the data indicated that certain sub- 
categories of the scoring criteria contributed 
more to the unreliability of judgment than 
did others. For example, it was relatively easy 
for the judges to discriminate reliably the 
“denial” and “blocking” categories, but was 
much more difficult for the judges to differ- 
entiate reliably between “intellectualization” 
(sensitizing) and “distancing from personal 
involvement” or “limited generalization” (re- 
pressive). 

To determine whether there is a tendency 
for individuals to use a general class of de- 
fense mechanism in different conflict areas, 
tabulation was made of the number of Ss 
using repressive mechanisms in both the 
sex and hostility areas, Ss using sensitizing 
mechanisms in both areas, and Ss using 
sensitizing defenses in one area and repres- 
sive defenses in the other. Table 1 shows 
this distribution. Those Ss having scores of 5 
(indicating an equal number of repressive and 
sensitizing responses) in either area are not 
included in this table. The difference between 
the number of Ss using consistent defenses 
and the number of Ss using different defenses 
is not significant. If Ss with scores of 5 (no 


Table 1 


Frequency of Ss Using Repressive and Sensitizing 
Mechanisms in the Sex and Hostility Areas 


Sex 
Hostility Represser Sensitizer 
Represser 23 32 
Sensitizer 12 26 


Note.—Chi square = 1.003, ġ > .30. 


218 


Table 2 


Intercorrelations Among Sex R-S Scores, Hostility R-S 
Scores, General R-S Scores, and Adequacy 
Scores for 83 Subjects 


General 
Hostility R-S Adequacy 
Sex +.24* +.32* = -01 
Hostility +.55* +.25* 
General R-S +.25* 


* Significant at .05 level. 


consistent mechanism) in one area are in- 
cluded in an analysis of defense by area, only 
39 per cent of the 140 Ss show consistent use 
of the same mechanism from one of these 
areas to the other. 

Further investigation of the generality of 
defense mechanisms was made by correlating 
the scores obtained by 83 of the Ss? for the 
four areas—sex, hostility, general R-S, and 
adequacy. Table 2 shows these correlations, 
which range from — .01 to + .55. All corre- 
lations except that between the sex and ade- 


quacy areas are significantly different from 
zero. 


Discussion 


The degree of agreement obtained between 
judges suggests that Tesponses to the sen- 
tence-completion task can be classified fairly 
reliably by use of the scoring criteria. While 
72 per cent agreement is far from perfect 
agreement, it seems adequate in view of the 
rather stringent agreement criterion adopted, 
of at least three of four judges making the 
same judgment from eight possible judgments. 

The results of this study by and large do 
not support a theory of generality of defense 
behavior. Although there appears to be a 
tendency for a large minority (39 per cent) 
of Ss to use the same defense mechanism for 
more than one area of conflict, the majority 
of the Ss did not Consistently use one class of 
defense mechanism. In addition, although sig- 
nificant correlations were obtained between 
scores representing mechanisms used in dif- 


3 These 83 Ss were those for whom data were 
available for several measures in a larger study. Care- 
ful examination revealed no apparent differences be- 
tween those Ss included in 


the correlation matrix 
and those not included. 
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ferent conflict areas, these correlations an 
quite low. There would be little oa 
over chance in attempting to predict any i 
S’s mode of defense in one area from nine 
edge of his defense mechanism in ano 
area. 
The findings in this study with ee 
generality of defense are in agreemen Gold 
the results of a study by Goldstein (5). aid 
stein found that the majority of his Ss TE 
not exhibit consistent defense preferenti 
though a large minority did. He con aic 
that there were two subgroups of Ss, is a 
defenders” and a smaller group of “ger 
ders.” , is 
ig but nonquantified evidence © 
available which argues against a ng 
consistency of defensive behavior. y = andl 
apparent in examining the scoring “jefense 
vidual Ss that some Ss use different iia 
mechanisms for subclasses of stimuli ae con 
single conflict area. For example, SE att ig 
sistently used repressive defenses ee, 
ing to heterosexual stimuli but ae wit homo- 
gave responses expressing concern abo eae B 
sexuality to stimuli not expected to vsitizing 
sexual response (by definition a or aa de 
mechanism). Another S used sensiti AE 
fenses in self-directed hostility ni Bg 
used repressive defenses in other-direc 
tility responses. 


heory 
The lack of evidence to support a t 


her pu% 


. S o 
zling the results of research emp Pi For 
lected on the basis of diagnostic la 7) 


essive” 
an auditory perceptual task, the a reifed 
compulsive Ss more accurately If de- 


threat words than did the hysteric $5- ather 
fenses are specific to conflict mes ale 
than general, why did the hysterics jesible 
ently show repressive behavior? One Poasist 
explanation is that there is greater mts 
ency of defense behavior among group ` mong 
nosed as pathological than there n reatet 
“normals.” Goldstein’s (5) findings © a de 
“emotional disturbance” for the genera ada 
fenders than for the specific detenana M 
support to this hypothesis. However, es be 
(6) did not find significant differenc 
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tween a pathological group and a normal 
group in response to “emotional” words on 
an auditory perceptual task. The question of 
whether pathological groups show more con- 
sistent defense behavior therefore remains un- 
resolved. 

Although reliability of judgment of the or- 
der found in this study is adequate for many 
research problems, greater reliability of judg- 
ments based on the criteria might be obtained 
if the subcategories of the criteria could be 
more sharply delineated. Experience gained 
through scoring the responses suggests that 
reliable differentiation of the subcategories 
depends upon response to extreme subtleties 
in verbal expression. As an example, to dif- 
ferentiate between “distancing from personal 
involvement” and “intellectualization,” it may 
be necessary to respond to the intensity of 
the verbalization. Experience suggests that an 
Intellectualized response reveals considerably 
more intensity of involvement in the verbal 
Material than does a repressive response. A 
response, “It bothers me to read in the news- 
paper that the Communists have taken over 
another country,” may be qualitatively dif- 
ferent from a response, “Zt bothers me to 
read about the Communists.” The specificity 
of the source, “the newspaper,” and of the 
disliked activity, “taken over another coun- 
try,” suggests more involvement in the verbal 
production, As this technique is used with a 
variety of Ss in a variety of situations, it may 
be possible to raise the reliability by delineat- 
ing the scoring categories in this manner. If 
reliability can be increased sufficiently, use 
of the technique as a clinical tool might be 
profitably investigated. 


Summary 


An attempt was made to devise a tech- 
nique which would permit specification of 


kinds of defense mechanisms used by indi- 
viduals in various areas of conflict. Scoring 
criteria were developed to aid in identifying 
repressive and sensitizing responses to a sen- 
tence completion task. Judges were able to 
classify Ss reliably by use of the scoring cri- 
teria. Converting judges’ classifications to a 
single score variable allowed comparison of 
defense mechanisms used in several conflict 
areas. In general a theory of consistency of 
defense behavior was not supported. 
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The Relationship of Anxiety and “Lack of 
Defensiveness” to Intellectual Performance 


Irwin G. Sarason 


Indiana University 1 


Two studies have recently appeared in this 
journal dealing with the relationship between 
Taylor Anxiety Scale scores and ACE per- 
formance. Matarazzo et al. (3) found anxiety 
Scores to be inversely related to ACE scores, 
while Schulz and Calvin (4) found no sig- 
nificant relationship between these two vari- 
ables. One deficiency common to these studies 
was the small number of subjects employed 
in certain of the anxiety groups. Thus, the 
low anxious group of Matarazzo et al. in- 
cluded only 13 Ss; Schulz and Calvin’s high 


A further pur 
vestigate the relation to intellectual perform- 


studies between the K scale and the Taylor 
Anxiety Scale, Pearson 7’s of — -74 and — 81 
have been reported by Heineman (1) and 
Matarazzo (2), respectively, Also, by includ- 
ing both of these scales in this study it be- 


measures such as 
those used in this experiment. 


Method 
Subjects 
The Biographical Invento 


ry (5) containing 
the Taylor and K scales w 


as group-adminis- 


*Now at VA Hospital, West Haven, Conn, 


tered to all Introductory Psychology ne 
enrolled at Indiana University at the a a 
the Fall 1954 semester. The 719 Ss ~ i 
this study include all of those studen a 
were entering freshmen and who comp 
the Fall semester. 


Procedure 


. in! 

Two measures of intellectual — 
were employed: ACE raw scores a E the 
over-all grade-point averages. In ze, ‘ellectl 
anxiety and K scales to the two T etr sn 
measures, Ss were divided into 7 se eroups 
4 K-scale groups. The yaar wat in 
were ordered from low to high anxie ” gle 
tervals of five. That is, the lowest oe | 
group included Ss with scores eae scores 
to 5, the highest group included Ss w ane 
ranging between 36 and 41. ae 34 Ss ip 
Ss in the lowest anxiety group an ther five 
the highest group. Each of the 0 
groups included at least 80 Ss. f score fot 

The following are the ranges 0 K group 
the four K scale groups: the lowest oad 
included all Ss with raw K scores a scores 
and 10, the highest included Ss with two 
between 21 and 30. The — 11- 
groups included Ss with score ranges rers I" 
15 and 16-20. The group of low K 5c tained 
cluded 134 Ss, the high K group oe d ove 
61 Ss. The other groups each contain 
200 Ss. 


Results | 


sig- 
Analyses of variance failed to reveil a 
nificant changes in grade-point pest scale 
increases in score on either the Anxie ee up 
or K scale. The F ratio for the me ee 
was .80, while the F ratio for the signifi 
groups was 2.20. This latter F was 
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Anxiety, Defensiveness, and Intellectual Performance 


Table 1 


Means and Standard Deviations of ACE Scores and 
Grade-Point Averages for K Scale Groupings 


ACE GP.A.* 
K-scale 
score N Mean SD Mean SD 
1-10 134 99.55 25.92 1.22 .76 
11-15 296 108.23 22.92 1.35.69 
16-20 228 109.17 22.04 142 .70 
21-30 61 107.90 23.82 1.36 -67 


(I a E 


* Grade of C = 1, B = 2, etc. 


cant between the .10 and .05 levels (3 and 
715 df). The Pearson r between K and grade- 
point average was found to be .07, which was 
not significantly different from zero. An in- 
Significant F of .83 for the mean ACE scores 
of the seven anxiety groups indicated a lack 
of relationship between increases in Taylor 
score and ACE total score. When an F was 
Computed for the mean ACE scores of the 
four K groups, an F of 5.48 was obtained. 
With 3 and 715 dj, this F is significant at the 
001 level. Table 1 presents the means and 
standard deviations of ACE scores and grade- 
Point averages for the 4 K-scale groups. In- 
Spection of this table clearly reveals that the 
significance of the F is due to the mean of 
the low K group which differs markedly from 
the means of the other K groups. The Pear- 
son 7 obtained between ACE and K scores 
was .09 (p < .05). 

The r computed between Taylor and K 
Scores was found to be equal to — .62 ($ 
< .001). An z was also computed between 
Taylor- and K-scale scores for all nonfresh- 
men (N = 448) in Introductory Psychology 
who took the Biographical Inventory at the 
same time as the Ss in this study. The ob- 
tained correlation was — .69, which is signifi- 
cantly different (p < .02) from the 7 of — -62 
for the freshmen. 


Discussion 


The results of this study are in agreement 
with Schulz and Calvin’s (4) demonstration 
of a lack of relationship between Taylor scale 
and ACE scores. The finding of Matarazzo 
et al. (3) that the higher the anxiety score 
the lower the ACE score was in no way sup- 
ported, As Schulz and Calvin suggest, one 
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explanation for contradictory outcomes of 
similar studies done at different institutions 
may well be due to extraneous factors asso- 
ciated with the institutions, e.g., difference in 
type of student body. It is interesting that the 
two studies indicating no relation between 
Taylor and ACE scores were done at large 
state universities, whereas the Matarazzo 
et al. study was performed at a private and 
relatively smaller institution. 

The results using the K scale are of sig- 
nificance in that they do not point to a 
gradual monotonic relationship between de- 
fensiveness scores and intellectual perform- 
ance. Both with the ACE and grade-point 
averages, it is clear that Ss in the low K 
group differ markedly from Ss in the rest of 
the distribution. 

The finding that low K Ss perform on a 
considerably lower level than all other Ss in 
the distribution leads, of course, to two pos- 
sibilities. The obtained result could simply 
be due to the fact that individuals with low 
scores on the K scale are not as bright as all 
other individuals. Another possibility, consid- 
ered more likely by this writer, is that low 
K scorers do poorly on tests like the ACE 
because of certain personality characteristics 
which are detrimental to good performance. 

It may be said of low K Ss that they are 
candid and self-critical in the extreme and 
manifest feelings of inadequacy by too freely 
admitting “bad” things about themselves. In 
a sense they are “lacking” in defensiveness. 
If this is so, it is plausible that these persons 
when confronted with a stressful test situa- 
tion in which they feel themselves being 
evaluated (e.g, the ACE) tend to respond 
with self-depreciatory attitudes. They may 
verbalize to themselves and recall their short- 
comings (e.g, “I am dumb, I can’t do it”) 
while working at the task. To the extent that 
this proneness to self-criticism results in the 
production of responses (e.g, “Maybe I 
won’t pass the test”) unrelated to the suc- 
cessful completion of the task, we would ex- 
pect it to be detrimental to a high level of 
performance. It is certainly hard to con- 
ceive of these interfering responses as being 
facilitative of high achievement. The result 
obtained in this study is what one would ex- 
pect; namely, a relatively low level of per- 
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formance from those Ss who are overly self- 
critical. 

The fact that the F ratio among the K 
groups was significant for the ACE and only 
approached significance for the grade-point 
averages suggests an interesting theoretical 
question concerning the development of an 
essentially intropunitive self-critical reaction 
to highly motivating situations in which the 
individual feels his ability is being evaluated. 
If one assumes that this lowering of the 
threshold for self-criticism is a learned re- 
sponse to situations in which the individual 
feels under pressure to perform well, we 
would expect that other possible responses 
more relevant to the task in question might 
similarly be learned. That is, the fact that 
someone has learned a nonadaptive habit 
does not preclude his eventually learning an 
adaptive one. For instance, individuals who 
feel that they are inadequate to cope with 
Stressful situations, such as taking an intelli- 
gence test, may, if in the situation long 
enough and given many trials, overlearn the 
relevant responses for high performance suffi- 
ciently so that the detrimental effect of the 
learned response of self-depreciation will be 
kept to a minimum. With regard to the pres- 
ent study, it is quite possible that the low 
K’s were able to reduce the effect of their 
interfering self-verbalizations over the course 
of a semester by means of overlearning the 
Course subject matter. On the other hand no 


overlearning was Possible in preparation for 
the ACE. 


A word remains to be s 
correlation of — 62 obtained between K and 
A. This correlation is considerably lower than 
those published in other Studies (1, 2). In 
order to determine whether this low correla- 
tion was purely a characteristic of students 
at Indiana University or whether it might in 
part be due to the fact that all the Ss were 
freshmen, the correlation between the two 
scales was computed for nonfreshmen as well 
as freshmen. The obtained correlation of 
— .69 for the upper-class group, while stil] 
lower than other studies, is more in line with 


aid concerning the 
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correlations reported in the literature. 3 
seems possible, therefore, that the two a 
may become more closely associsten He 
length of time in college increases. We i 
already mentioned that the type of a n 
body from which Ss are sampled en se 
important factor and there are ertani ie 
socioeconomic factors which are equally ae 
vant. At the present time it would aed a 
Matarazzo’s suggestion (2) that t e ben 
scales be used as alternate forms is Pre 
ture. 


Summary 


luate 
This experiment was performed to eva 


the effects of anxiety (Taylor-scale scores 
and defensiveness (MMPI K-scale SCOrE a 
intellectual performance (ACE ara to 
grade-point averages). The results a aia 
show significant changes in these a “aton 
ures of intellectual performance asa cane 
of anxiety. However, Ss low in a more 
were found to perform ne el $5 in 
poorly on the ACE than did all ot me i 
the K-scale distribution. A similar Mina i 
found for the grade-point averages. adverse 
sults were discussed in terms of the PS of 
effect of the self-criticism of low r situa 
their performance in highly motivating 
tions. 
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Evaluative Conceptualizations as the Basis for 
Clinical Judgments? 


Franklin C. Shontz 


Western Reserve University ? 


P In spite of the general admiration for “ob- 
jectivity” in psychology, it has frequently 
been observed that there is considerable room, 
especially in our clinical practices, for the ac- 
tion of “subjective,” and therefore perhaps 
also detrimental, influences (1, 2, 3, 6). The 
real question is not simply whether this “sub- 
Jectivity” is actually present as a factor in 
Clinical diagnosis, but whether clinical judg- 
ae are sufficiently reliable phenomena to 
Pe considered useful as a basis for making 
decisions about the human personality. 

Obviously, the problem is too broad to be 
handled in any single empirical investigation, 
but at least one important aspect of the clini- 
cal situation may be relatively easily ap- 
Proached, and shows promise for fruitful re- 
Search, viz., the basis upon which psycholo- 
gists make judgments regarding the “mental 
health” of their subjects. 

We will assume for the present that, on the 
basis of their training, clinical psychologists 
are capable of building up fairly accurate de- 
scriptive conceptualizations of their patients, 
and that they make judgments and evalua- 
tions of these subjects on the basis of a par- 
tially subjective comparison of these descrip- 
tive conceptualizations with some standard or 

ideal” picture of mental health, adjustment, 
or what have you. It follows, then, that two 
psychologists may differ in their judgments of 
the same individual mainly because they have 


1Subproject of a dissertation presented for the de- 
gree of Doctor of Philosophy at Western Reserve 
University. The valuable advice and critical com- 
ments of Dr. D. W. Miles and the other members of 
the doctoral committee, Drs. C. S. Hall, C. F. Baker, 
C. R. Porter, and R. Fisher, are gratefully acknowl- 


edged. 
2 Now at Highland View Hospital, Cleveland, Ohio. 


grossly different “ideals” against which the 
subject is being compared. It also follows 
that it would be worthwhile if we could make 
these ideal conceptions explicitly measurable 
so as to assess their internal reliability (con- 
sistency within any single psychologist) and 
the extent to which clinicians would be found 
to agree with each other. 

The purpose of the present research has 
been to use Q-sort method (5) in the ex- 
amination of psychologists “evaluative con- 
ceptualizations” and to determine the extent 
to which these may be said to represent re- 
liable and consistent diagnostic phenomena. 


Method 


Subjects. The subjects were twelve psy- 
chologists, all of whom were employed in the 
same state hospital setting. Of these twelve 
individuals, seven were full-time, permanent 
staff members and five were half-time gradu- 
ate students in clinical psychology. All but 
one were currently engaged in diagnostic and 
therapeutic work with psychotic patients. 
The students were under the supervision of 
experienced staff members at all times, and 
none of these students had been in graduate 
school less than two years at the time of this 
investigation. 

Measurements. The measuring device was a 
60-item, structured-sample Q sort, adminis- 
tered in two equivalent forms of 30 items 
each. Q-sort items were selected to fill a 3 X 
2x 5 factorial scheme twice over. In this 
scheme, the first dimension reflected rigidity, 
flexibility, or disorganization of the person- 
ality processes ; the second dimension re- 
flected the direction of psychological energy 
either toward the self or toward others; and 
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the third dimension defined specific item- 
content in terms of positive affective relation- 
ships, negative affective relationships, cogni- 
tive processes, aspirations, and techniques of 
adjustment. Details regarding the methods of 
scale construction, the means for establishing 
equivalent forms, and the nature of specific 
item-content are available elsewhere (4). 

Q-sort items were sorted by the subject 
into nine piles to describe two separately re- 
quested conceptualizations. The 30 items of 
one form were first placed into the required 
distribution, and the task was immediately 
repeated with the 30 items of the equivalent 
form. Order of presentation of the forms was 
randomly distributed. The nine piles used 
were quasi-normally distributed in frequency 
of card placement from “most descriptive” to 
“least descriptive,” and scores were assigned 
to each pile in the usual manner. The actual 
frequency distribution employed was: 1; 2 
3; 5; 8; 5; 3; 2; 1; and the Scores assigned 
to these categories ranged from O for the 
least descriptive item to 8 for the most de- 
scriptive one. 


Procedure, Each subject was asked to use 
both 


obtained, 


The two frames of reference in which the 


cards were sorted were specified in the follow- 
Ing set of directions: 


1. Describe first a perfect]; 
one for whom you would 
release from the hospital 
logically healthy person, 

2. Now describe an ideal hospitalized patient, one 
who might be considered for discharge if the home 
conditions were proper; one who would most likely 


y recovered individual, 
unhesitatingly recommend 
*..in short, a Psycho- 


The descriptions provided by the subjects 
were first evaluated for intrasubject reliability 
on the two equivalent forms of the Q sort. 
The mean correlations between all Possible 
pairs of subjects were then computed to yield 
indices of homogeneity, or intersubject reli- 
ability on both measures, 

An over-all analysis of variance was per- 
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formed to determine which groups of on 
were significantly high or low in their d 
tive scores and whether differences cou ms 
found between the two sets of descrip 
obtained. 

Finally, composite descriptions of a 
“ideal” were constructed by ge 
mean placement values (descriptive ot 3 
for each item and by redistributing “1 di 
items back into the original quasi-norne a 
tribution according to their average Nee 
These composite descriptions were n me. 
related and compared in ame e the 
Placements as a means for apes two 
similarities and differences between 
conceptualizations investigated. 


Results 


seas the 
The mean intrasubject reliabilities Be, 
described conceptualizations were ate an 
82 for the healthy person area! 
‘80 for the descriptions of the idea roduct- 
ized patient. (All figures are Pearson p values 
moment correlation coefficients.) Tie 
compare satisfactorily with the zea eir 
many psychological pe i E were 
Magnitudes indicate that the ey remaine! 
describing conceptualizations whic ting to the 
fairly stable, at least from one sorti 
next. ait om0” 
The mean intersubject oor alt 
geneities) were found to be .68 phe 
Person descriptions and .59 for tl a 
tions of the ideal hospitalized pa 
figures indicate a moderately i 
agreement between subjects, i a few 
Suggest that there were probably Toamna 
differences with respect to specific i osite de 
The intercorrelations of the pee were 
Scriptions constructed for both “i he sort 
found to be .72 on one form of ke indica” 
and .67 on the other. Again, there e sa 
tion that the two ideals are much js no is 
in over-all characteristics, but me of thé 
dication of agreement on all item ‘ 
Measuring instrument. ; sort 
Atalons of variance of the obtain i 
ings revealed the following signi item struc” 
categories, according to the Q-sort i y 
ture already outlined: h dless of 8 
Items reflecting flexibility, regar ptain sig 
rection or content, were found to 0 


descrip” 
t. Thes? 
level 0 


Evaluative Conceptions 


nificantly high descriptive values in both con- 
ceptualizations. 

Items reflecting disorganization, regardless 
of direction or content, were found to obtain 
significantly low placement values in both 
conceptualizations. Especially low placement 
was given to items reflecting disorganization 
of the negative affective relationships. 

Items reflecting rigidity, regardless of di- 
rection or content, were found to obtain sig- 
nificantly low values only in the descriptions 
of the psychologically healthy person. 

_ What these findings mean in terms of spe- 
cific item content was determined by examin- 
ing the composite sortings to locate those Q- 
sort statements which received both highly 
consistent and highly inconsistent placement 
when one “ideal” was compared with the 
other. 

s The following are examples of items con- 
sidered by the subjects to be “desirable” (as- 
signed to the upper extreme categories of the 
Q-sort distribution) in both conceptualiza- 


tions: 3 

18. Considerate of others in his personal relation- 
ships. 

16. Understands the feelings of others. 


_ The following are examples of items con- 
sidered by the subjects to be “undesirable” 
(assigned to the lower extreme categories of 
the Q-sort distribution) in both conceptuali- 
zations: 


23. Likely to commit impulsive suicide. 
57. Likely to get uncontrollably angry W 
for no good reason. 


The following are examples of items which 
were considered desirable for the healthy per- 
son, but “unimportant” (assigned to & middle 
category) for the ideal patient: 


ith others 


12, Likes people for what they are. 
15. Knows his own assets and liabilities. 


The following are examples of items consid- 
ered to be undesirable for the healthy person 
and unimportant in the ideal patient: 


6. Makes inflexible all-or-none judgments about 
people which he won't change even in the face of 


facts. 
ae 


8 The item numbe 
nal Q sort. 


rs are those assigned in the origi- 
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4. Believes in severe punishment for peo) le he 
thinks are immoral. m 


The following item was considered desir- 
able for the ideal patient but unimportant for 
the healthy person: 


14. Never gets angry at people without good 
reason. 


The following item was considered to be 
“undesirable” for the ideal patient but unim- 
portant for the healthy person: 


57. Takes the first opportunity he sees to satisfy 
an impulse. 


There were no items which were considered 
undesirable in one description and desirable 


in the other. 
Discussion 


The present research indicates a very sub- 
stantial level of over-all agreement in the 
evaluative conceptualizations of this group of 
psychologist-subjects. If we bear in mind that 
the reliability of the single subject in this 
study was about 80, it is evident that any 
intersubject reliability which approaches this 
value would indicate as great an agreement 
between subjects as exists within them indi- 
vidually. If this were the actual case, one 
would expect psychologists to be a sterile lot 

o more disagreements with 


who never get int 
each other than they do with themselves on 
the basis of their own individual inconsist- 
ency- 
Actually, these results are about what one 
might hope for. The figures show sufficient 
agreement so that we might expect this group 
of psychologists to be agreed at least “in prin- 
ciple”; but the figures do not show sufficient 
conformity to indicate a rigidity of concep- 
tion throughout the sample. From the pa- 
tient’s point of view this would seem to indi- 
cate that one could be quite certain of re- 
ceiving & consistent evaluation regardless of 
which of these psychologists were diagnosing 
him (as long as there were no errors in the 
descriptive conceptualization itself), but that 
specific bits of behavior might have different 
meaning or importance depending upon the 
examiner. 
The “ideal” conceptualizations obtained 
here cannot be said to be right or wrong ex- 
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the basis of the acceptance of some 
et od set of standards. The data indicate, 
however, that these psychologists do recog- 
nize differences between the requirements of 
hospital and nonhospital society. They fur- 
ther reveal an emphasis upon flexibility and 
the need for recognizing others in one’s be- 
havior. One cannot be sure what causes these 
conceptualizations, but it is apparent that 
this sample is highly coherent as a group. It 
would be interesting in the future to examine 
less homogeneous populations and to make 
comparisons between the “ideals” of behav- 
ior which characterize various professional 
groups, or which characterize psychologists 
in various cultural and social environments. 
It would be equally interesting to study, for 
example, the development of evaluative con- 
ceptualizations as a student progresses through 
training in psychology. 

The Q-sort scale employed here was de- 
signed for use in describing the behavior of 
Psychotic patients, and the extreme character 
of some of its items may have induced a level 
of agreement which is greater than one would 
normally expect. Nonetheless, this in 
tion has demonstrated the feasibility of ex- 
amining these conceptual “ideals” by which 
not only Psychologists, bu : 


; t all people make 
judgments about each other, 


vestiga- 


Summary 
A Q-sort investigation was made of twelve 
psychologists conceptualizations of the psy- 


C. Shontz 


chologically healthy person and the ideal hos 
italized patient. z 
j Equivalent Q-sort forms were - eo 
tablish intrasubject reliabilities, an se 
were found to be .80 and .82 respectively 
the two conceptualizations. në 
Average intersubject agreements yee aa 
to be .68 for the psychologically hea Y Tone 
son descriptions, and .59 for the descr P aes 
of the ideal hospitalized patient. ag Br ‘5 
were interpreted as indicating a hig but by 
general agreement between vo ame inion 
no means as expressive of a unity of oP 
on all specific trait items. ne 
The oe were analyzed to reveal ee 
ences between the two conceptualization® t 
samples of specific items were presen 
illustrate the findings. 
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Some Correlates of the Davis-Eells Tests 


Grace T. Altus 


Santa Barbara County Schools 


di The preponderance of research evidence in- 
rei that there is a significant relationship 
cae I measured intelligence and socioeco- 
less a in that lower-class members do 
nomic hi than those higher in the socioeco- 
intelli ierarchy on virtually all widely used 
ie og tests. There is considerable dis- 
and EA among psychologists, sociologists, 
which ae social scientists as to the extent to 
of the « is positive relationship is a function 
used t culture-bound” nature of the devices 
to E AT intelligence and the extent 

| eren ich it is a function of true, innate dif- 
| ing ces in the intellectual capacities of vary- 
a ae ene or social classes. Probably 
eae deny that test biases are re- 
fere e for some of the measured class dif- 

nes, 
tle “a hope of minimizing, in their test, the 
intellig bias assumed strong in most group 
53 gence tests, Davis and Eells (1) in 
nlia the Davis-Eells Test of General 
ise leo or Problem-Solving Ability, other- 
test known as the Davis-Eells Games. The 
it yields an Index of Problem-Solving Abil- 
4 (IPSA) derived in the same fashion as an 
E is a power test, requires nO reading, 
o sta primarily of pictorial representations 
S galtiple-choice problems for which the 
hie er reads the problem, and is said to be 
ager E and challenging to children of all 
oe levels. It was designed for use 1m the 
and Six grades of school and has a primary 
elementary form. 

so he appeal of such a test 

| Mhel is strong. Many teachers, as well as 
. Aymen, are wary of standard intelligence 
| tests, They know that not all their children 
ate identified correctly by current tests. All 

f Sf them would welcome an index of true 
) ‘Carning ability which would identify those 


punnan a 


to school per- 


pupils who are and those who are not work- 
ing to capacity. Is the Davis-Eells Test such 
an index? 

Problems of test validation are nearly in- 
surmountable if one accepts the assumption 
of Davis and Eells that school grades, read- 
ing skill, and other measures of academic suc- 
cess cannot be accepted as validation criteria 
since these indices are strongly culture-bound, 
whereas the whole intent of the Davis-Eells 
Test is to minimize such social structuring. 
With what, then, can one correlate the test to 
assess some measure of its validity? The au- 
thors seem to accept no external criteria. The 
validity of the test must be taken on faith— 
that is, in consideration of the reasonableness 
of the test problems, the care taken in the 
eight years of test standardization, and the 
extent to which one agrees with the authors’ 
premises and their criticisms of other intelli- 
gence tests. 

Beyond its theoretical and research inter- 
est, however, a test must have some demon- 
strated relationship to some aspect of the 
school program to justify its widespread use 
for school purposes. Group intelligence tests 
now in use in schools have amply demon- 
strated effectiveness in predicting academic 
achievement, grouping pupils, aiding in vo- 
cational counseling, identifying underachiev- 
ers, and the like. That they do these things 
imperfectly is obvious, but that they do them 
better than they could be done without tests 
is equally apparent. 

In terms of practical considerations, then, 
if the Davis-Eells Test were to supplant pres- 
ently used intelligence tests in the schools, it 
would need to be demonstrated that the test 
could perform the aforementioned functions 
better. If it were to supplement other tests, it 
should shed some new insights regarding spe- 
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cific children or groups of children. Since no 
single set of criteria appears available to as- 
sess its value in these roles, Particularly the 
latter one, perhaps an accumulation of ana- 
lytical studies may show Ways in which the 
test could be used to advantage. 


Problem 


The intent of the present study was not to 
investigate the general validity of the Davis- 
Eells Games. Instead it Poses several specific 
questions which, if the authors’ premises be 
accepted, do not necessarily bear upon true 
test validity but are nevertheless relevant to 
the test’s practical 
setting: (a) What are the interrelationships 


among the Davis-Eells Test and the Cali- 
fornia Tests of 


Mental Maturity 
fourth-grade children? (b) Are the scores of 


bilingual children, which were not included in 
the standardizati 


Eells Test thou 
lowered by culture-bound ite: 
better on the Davis-Eells th 


Subjects 


the Elementary A form of the Davis- 


Since 
Eells Games (hereafter referred to as the 


of a county-wid i 
relatively homo 
nated the need t 
in subsequent test correlations, 

Children from all the fourth-grade classes 
of four elementary schools of Santa Barbara 
County participated in the study. The four 
schools, whose enrollments were between 300 
and 700, were within a radius of ten miles 
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from the city of Santa Barbara. Two E 
schools drew their pupils from apoye a aed 
residential areas, while the other two be ee 
a higher percentage of children of a iin 
workers. The first two schools had to mn 
gual children, whereas in the latter i s 
proximately one child in five came 

home in which Spanish was spoken. is hed 

Prior test surveys in the four schoo ri fe 
Suggested that, taken together, they ice de 
a reasonable cross section of a fourt = re 
school population. This later proved to ek 
case, with some minor exceptions to 
reference will be made later. 

A total of 184 children from the classes of 
nine teachers in the four schools conste 
the final sample to whom all tests were i est 
There were 93 boys and 91 girls. eal 
Pupils represented 81 per cent of the the 
actual enrollment of all fourth-graders ìn ally 
four schools. No children were intention 
omitted from the study, but absence on ind 
or another of the testing days and other fect 
avoidable circumstances prevented per 
participation. 


Method of Test Administration 


. all 

Four group tests were administered A 
the children in their regular plasson the 
their regular teachers. These ie o! 
Games, Elementary A; the California jemen 
Mental Maturity (CTMM), 1950 E Tel 
tary S-Form; the California Reading Arith- 
Elementary AA; and the California 
metic Test Elementary AA. wo 

All tests were given during the et ee 
Months of the fall school term and rO given 
So that in some classes the Games were Test 
first, in others the CTMM, and so on. pees 
ing did not start until the term had telli- 
under way for several weeks. The two a two 
gence tests were given within a period i test5 
weeks of each other in each class, and al jthia 
in all four schools were administered ime 
a calendar month and five days. Some e 
interval between tests was felt imperativ re- 
the teachers to avoid student fatigue ri pro- 
vent undue interference with the schoo 
gram. de 

Cumulative folders for all pupils were iting 
available by the schools. Information re ve 
to parental occupation, birthplaces of pa 
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and child, language of the home, address, and 
date of child’s enrollment in the given school 
were recorded when available. 


Results 


Test interrelationships for total sample. As 
far as mean scores on the two intellectual 
measures were concerned, the CTMM IQ and 
Games IPSA were virtually identical. Both 
were only a point above the norms of the 
standardization samples. Since the mean age 
of the children was exactly that of the Cali- 
fornia Test Bureau figure for fourth-graders 
in their second month of the school term, the 
sample may be considered representative in 
this respect also. 

In several respects it deviates slightly from 
the norm, however. The standard deviation of 
1Q’s for the CTMM and its subtests exceeds 
the norm, while that for the Games is less 
than the standard deviation indicated in sev- 
eral studies reported in the Manual (1). 

More striking is the discrepancy between 
CTMM Language and Non-Language quo- 
tients favoring the latter. This is perhaps due 
ìn part to the scores of the bilingual children, 
Whose relatively greater aptitude on non- 
verbal tests might be anticipated. : 

The reading-grade placements of the chil- 
dren, as can be seen from the table, were at 
the expected level. Their arithmetic scores 
Were slightly below. The latter is perhaps due 
M part to differential rates of summer for- 
Setting, with arithmetic scores the more likely 
to suffer from holiday disuse.* 

Intercorrelations of the intelligence tests as 
Shown in Table 2 indicate that the CTMM 
and Games are related less closely than most 
widely accepted intellectual measures. As one 
might have expected, the Games are more di- 


*It was originally planned that the reasoning and 


fundamentals subtests of the arithmetic test should 
e given separati 
Separatel, 


tively hypothesi: 


on-Language than to the other 
hypothesized that pilingu 
x significantly better on the 
fundamentals test. Since neither of “these hypotheses 
was supported by the data, only the total arithmetic 
score is reported herein. 


229 
Table 1 
Characteristics of Sample with Respect to 
Age and Test Results 
Item Mean SD 
Age 9 yr. 4.3 mo. 6.4 mo. 
Davis-Eells IPSA 101.0 15.5 
Davis-Eells Raw Score 39.2 7.0 
CTMM Total IQ 101.3 18.0 
CTMM Language IQ 97.2 19.3 
CTMM Non-Lang. IQ 107.4 22.7 
Calif. Read. Gr. Pl. 4.1 1.4 
Calif. Arith. Gr. Pl. 3.9 8 
Table 2 


Pearsonian Correlations Between Measures 
of Intelligence 


CTMM IQ 


$$ 


Non- 

Test Total Lang. Lang. 
Davis-Eells IPSA 49 37 46 
CTMM Total IQ 86 76 
CTMM Language IQ 42 


rectly related to the CTMM Non-Language 
Test, which requires no reading, than to the 
Language Test, which does. Still the CTMM 
Total IQ has the highest 7 with the Games. 
The latter correlation of 49 is reasonably 
typical of those reported in the Manual for 
the Games vs. several forms of the Otis. i 
The relationships obtained from correlation 
of the Games with the achievement tests were 
also remarkably similar to comparable calcu- 
lations reported in the Manual, where median 
coefficients of .43 for the Games vs. reading 
and .41 for the Games vs. arithmetic were re- 
ported for several batteries of achievement 
tests. It can be seen from Table 3 that the 


Table 3 


i i tween Measures of 
Pearsonian Correlations Bet 
Aptitude and Achievement 


Davis- CTMM 
Eells — 
hievement Test Raw Tot. Lang. N-L 
AeA picemenat Score MA MA MA 
California Reading 48 TW M 49 
California Arithmetic 43 67 58 52 
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CTMM Total has the highest degree of as- 
sociation with both indices of achievement. 
The CTMM Language has the next highest 
correlations, followed by the Non-Language 
which exceeds the Davis-Eells only slightly. 
Some changes in these correlations would 
have been effected by corrections for range, 
since the CTMM range was too wide and the 
Davis-Eells too narrow, reducing the correla- 
tions with the CTMM and increasing those 
with the Davis-Eells, 

The bilingual sample. A bilingual child was 
herein defined as one whose school records 
included the written notation that a language 
other than English was spoken in the home. 
Such children, 31 in number, constituted 17 
per cent of the total sample. Spanish was the 
second language of 27 of the children, Japa- 


nese of two, and German and Italian of one 
each, 


beyond the junior high sch 
A comparison of 
bilingual children o; 


mes, followed closely þ 
the CTMM Non-Language, As might ho = 


pected, the children’s mean Language I 
the lowest of the three. The E ee 
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Table 4 
Test Results for Bilingual Sample 

Test Mean SD 
4 
Davis-Eells IPSA 97.7 pe 
CTMM Language IQ 86.7 249 
CTMM Non-Language IQ 93.8 13 
Calif. Reading Grade 3.7 3 

Calif. Arith. Grade 3.7 


IQ points between the Games IPSA = 
CTMM Language IQ is significant at the - e 
level of confidence, but the 4-point difference 
between the Games and CTMM Nonian 
guage had a critical ratio of only .74 and is, 
therefore, insignificant, r j- 
Parental occupation and measured a 
gence of children. It had been hoped 2 pen 
nally that it would be possible to obtain A 
Index of Status Characteristics for each = d 
in the study, following the method nae 
by Warner, Meeker, and Eells (4). Un ie 
tunately, the information recorded in for 
available school records was inadequate = 
such a detailed appraisal. Even such ites a 
Parental occupation were frequently state 4” 
an equivocal manner, e.g., “Self-employe e 
Nevertheless, parental occupation was dex 
cided upon as the best single available in > 
of class level, and each child was a 
rating of from 1 to 7 following the catego! 
in the aforementioned reference. as 
The resultant distribution of scores, va 
definitely Overweighted in the professioni 
and semiprofessional areas, with 17 per a 
of the children so categorized. The paren re 
occupations of 58 children unfortunately ge 
either not given or not classifiable berar se 
an inadequate description. Because of t ni 
marked limitations in the data, detailed 5 i 
tistical treatment seemed inadvisable. ee 
theless a Tough grouping of the classes m 
made and mean IQ’s computed. Results 4 
shown in Table 5. rk- 
The fourth occupational class—skilled a 9, 
rs—had mean quotients of 105.0 and 10 in- 
respectively, on the CTMM and Games; er 
cluding them in the grouping of the a 
classes would have increased the significan 0 
of the difference between the test mican, ifs 
the .01 level of Confidence. As it is, the @ 
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Table 5 


Parental Occupation and Intelligence Test Scores 


CTMM IQ Davis-Eells IPSA 
Occupational 
class N Mean SD Mean SD Diff. CR 
Top 3 classes 41 113.1 10.2 106.4 13.4 6.7 2.55 
Bottom 3 classes 67 95.6 16.1 97.9 14.0 23 88 


ference is significant at the .02 level, and in 
the expected direction: children from above- 
average backgrounds do better on the tradi- 
tional type of intelligence test than on the 
ames. Yet the reverse does not hold true to 
a statistically significant degree; the children 
from the less privileged classes as here de- 
fined did not do significantly better on the 
Games than on the CTMM. The trends are 
in the expected direction but their magnitude 
1s minimal. 
_ The difference in variability in the two tests 
is also of interest. The difference between the 
CTMM standard deviations of scores for the 
top as opposed to bottom three classes is sig- 
nificant at the .01 level. That is, the top three 
Classes have significantly less variability on 
the CTMM than do the bottom three classes. 
On the other hand, the variability of Games 
Scores for the opposing occupational group- 
ings is roughly the same. The CTMM scores 
appear closer to what one would expect of a 
culture-bound” test. 

The scores of children whose parental oc- 
Cupations were not given or were ambiguously 
Stated had means of 98.4 and 100.1 on the 
CTMM and Games, respectively. It is pos- 
sible that there was a disproportionate share 
of lower-class children in this group, but even 
including them with the lower groupings 
would have affected the findings but little. 
oe of intelligence test discrepancies. 
rere a Lag had indicated that problem- 
hs ane as measured by the Games 
ee As De strictly equated with standard 
current ‘wie eee as measured by most 
fheretove ni tests. It seemed of interest, 

A EO examine in some detail the 
characteristics of those children whose IPSA 
and IQ were markedly in disagreement, to 
see if meaningful correlates of the variable 
could be determined. A difference of 20 oF 


more points between the scores obtained by 
a given child on the two tests was chosen 
rather arbitrarily as a cutting point which 
should indicate both statistical and diagnostic 
significance. Table 6 described the children 
who so excelled relatively on the Games and 
CTMM respectively. 

One child in four had an IQ-IPSA discrep- 
ancy of 20 points or more. It can be seen that 
the children performing markedly better on 
the Games than on the CTMM constituted 
a slightly larger group than its opposite 
analogue: 14 per cent vs. 11 per cent of the 
total sample. As would have been hypothe- 
sized, more bilinguals excelled on the Games 
than CTMM. 

The sex ratio is perhaps the reverse of what 
might have been anticipated in view of the 
stereotype of the greater verbalism of girls. 
More girls actually do better on the Games 
while more boys do better on the CTMM. 

The test scores of the children excelling on 


Table 6 


Characteristics of Children with IPSA-CTMM 
Discrepancies of 20 or More Points 


IPSA CTMM 
Item Greater Greater 
25 21 


Number of children 
Number of bilinguals 9 1 


Sex ratio, boys/girls 11/14 12/9 
Mean Davis-Eells IPSA 112.8 96.0 
Mean CTMM Total IQ 86.4 123.9 
Mean CTMM Language IQ 82.0 122.0 
Mean CTMM Non-Language IQ 92.0 124.0 
Mean Reading-Grade Placement 3.6 53 
Mean Arithmetic-Grade Placement 3.7 4.5 
Parental occupation : 
Classes 1-3 2 4 
Class 4 3 4 
Classes 5-7 11 6 
Unknown 9 7 
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the Games over the CTMM Present, except 
for the IPSA, the test-score pattern of poor 
students. Their IQ’s on the CTMM and its 
subportions are dull-normal to low-average; 


Conversely, the 21 children with higher 
test scores on are classified by 


however, they would have been de- 
scribed as slightly below average. 


Both groups of children, nevertheless, have 


Parental occupational ley 


extent the expected trend 
Proportion of u 


els follow to some 


in that a higher 
Pper-class children did better 


A group of 184 fourth-gra 
sonably 


terms of 


Includin i 
Eells Games, the aliforni Test iors 
aturity, and the California Tests of Read- 
ing and Arithmetic Interrelationsh 
the tests i 


Grace T. Altus 


tained because of the test authors’ pee. 
that academic performance is not an hae A 
table validation criterion, it may nad enn 
sumed from the relatively low corre r. d 
obtained that the Games should not ia tests 
in place of standard group elaine upils 
for Predicting school success, grouping aad 
for instructional Purposes, and similar 
tional uses, , e 
Comparison of the scores derived ne ne 
Games with those from the CT) octal 
bilingual children and children at t con- 
social-class levels suggested, though T jak 
clusively, that children with a bilingua might 
ground and/or lower-class aang Ft a 
do better on the Games than the C ihoa 
Trends were so slight that they need ri an 
tion through other studies. Because aac 
atypical distribution of parental occupa cats 
it was deemed inadvisable to compute and 
relations between socioeconomic pee ee 
aptitude, Havighurst (2) reports coe ae 
of .37 and .34 between the Games and S ad 
economic status for fourth-grade ag 
oys, respectively, from a midwestern er 
munity of approximately the same wr The 
one from which these data were obtained. ats 
findings in Combination suggest that w. ibe 
ever gains lower-class children make men 
ames as opposed to other es meal 
Would be slight. Use of the test in e weet 
tary schools at present except as a etal 
instrument does not appear to be warra 
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A Procedure for Obtaining Self-Ratings 
and Group Ratings’ 


Wilse B. Webb ° 
U. S. Naval School of Aviation Medicine 


This is a report of the development of an 
effective technique for obtaining peer ratings 
and self-ratings of individual characteristics. 

The procedure grew from research con- 
cerned with relations between group evalua- 
tions, self-evaluations, and objective meas- 
ures (1, 3). In this research an odd obstacle 
developed. It was possible to obtain reliable 
Stroup ratings by peer-nomination or rating- 
scale procedures for such characteristics as 
intelligence, leadership, personal charm, and 
the like. The difficulty lay in the self-ratings. 

Sing either a self-ranking or a rating-scale 
Procedure these ratings were quite unreliable. 

t was clear that until the reliabilities of the 
self-ratings could be increased the meaning- 
fulness of our interrelations was limited. 

As noted in a previous paper (3), manipu- 
lations of reliability formulas indicated that 
the high reliability of the group ratings ac- 
crued primarily from the number of ratings 
obtained on a given individual. Further, the 
lack of reliability of the self-ratings, using 
rating-scale or ranking procedures, yielded 
low reliabilities because of the “shortness” or 

Single item” characteristic of the rating. 

; There were two alternatives available for 
increasing the reliability of the seli-ratings. 
Vne alternative is to turn to self-inventories 
im which a large number of related but differ- 
ent self-statements are made which are likely 
to be related to a given trait. For example, 
we could use the Guilford-Martin inventory 

1 Opinions and conclusions contained in this report 


TE ose of the author. They are not to be con- 

S necessarily reflecting the view or the en- 
dorsement of the Navy Department. 
A 5 

My thanks are due to and freely given to Ed- 


ward J. Wallon for his hélp i 5 5 
calculations. elp in data collecting an 


to measure friendliness. On the other hand, 
we may attempt to obtain a large number of 
self-statements on the same question. For ex- 
ample, “How friendly are you?” could be 
asked a number of times. This procedure 
pursues the latter alternative. 

For convenience’s sake, the procedure is 
titled the “SPM Procedure.” It will become 
clear in discussing the procedure that these 
initials stand for “self-plus-minus.” 


Procedure 


To increase the number of statements that 
the man made about himself, a method of 
paired comparison was introduced. Very sim- 
ply, the individual was given a roster of the 
individuals within his group. He was asked 
to go through this roster and compare him- 
self with every other man in the group. If he 
considered himself superior on a particular 
trait to a given man, he assigned a plus by 
that name. If in contrast he considered him- 
self inferior on a given trait, he assigned a 
minus to that name. His self-rating rank 
within the group then could be given by sim- 
ply counting the number of pluses which he 
assigned to the members of his group and 
subtracting from the total W. If, for example, 
he had given 15 pluses in a group of 24 men, 
he considered himself to be superior to 15 
men in that group and 8 men to be inferior 
to him, and his rank on that particular trait 
from his point of view was 9 in the group 
(24-15 = 9). 

In working with this SPM procedure, an 
additional benefit was noted. By summing the 
total number of pluses assigned an individual 
by all members of the group (the number of 
men who consider themselves superior to an 
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Table 1 
A Model of the SPM Rating Procedure for Five Cases 


Group 
A B CODE ranks 
A aS 4 ee 2 
B + = $ $ 4 
a + + + + 5 
D FS = + 3 
E ty = $ 4 
Self-ranks 1 3 5 2 1 


+ = column designee considers himself superior to row 
designee, 


= = column designee considers himself inferior to row 
designee. 


Self-ranks = 5 — pluses of each column, 
Group ranks = 1 + pluses of each column, 


individual) and by adding 1 a ranking of the 
group judgment of this man could be ob- 
tained. An example is given in Table 1. Let 
us assume that there are five men in a given 


in number from 21 to 3 
acteristics of intelligence 


Wilse B. Webb 


used. Estimates of the reliability within a 
given session and between sessions for E 
two characteristics were obtained for bo 
the group ratings and the self-ratings. These 
data are summarized in Table 2. 

The between-session reliabilities of the a 
ings given in Table 2 are the averages of ne 
product-moment correlations for each of a 
eight sections between the fourth- and he 
teenth-week administration of the forms. T. 
Within-session reliabilities are the avoriai 
reliability estimates within the fourth- an 
fifteenth-week administrations obtained for 
each section. These estimates were made by 
an analysis-of-variance procedure (comparing 
the row and column variances with the es 
maining error variance). The average mam 
ber for each section in the fourth week was 
28.7 and for the fifteenth week the average 
N was 25.9, x 

These reliability estimates may be on 
pared with the reliabilities of group rating 
obtained by peer-nomination procedures an¢ 
rating-scale procedures from data on cor 
parable populations. The widely used esi 
nomination technique has been applied to . 
number of cadet populations. The group ee 
bers were asked to write the names of th 
three “highest” in their section on leadership 
Potential and also the three “lowest” on lea ]- 
ership potential. Group measures were ane 
oped by assigning a plus when a man pie 
nominated “high” and a minus when a cael 
Was nominated “low” and algebraically ol 
ming the pluses and minuses for ee eee 
Vidual within the group. An average ae 
Session reliability of this technique for z 
sections of cadets has been reported as - 4 
(2). The total number of cases in the study 


Table 2 


Reliabilities Within and Between Sessions for SPM 
Groups and Self-Rating on Intelligence 
and Leadership 


Intelli- Intelli- Leader- mae 
gence gence ship 2 al f- 
group self- group sting 
Week rating rating rating ze 
áth 90 91 92 = 
15th 2 90 92 ms 
4th-15th 76 58 75 6 


toad 


| 


Obtaining Self-Ratings and Group Ratings 


was 116. A between-fourth-and-fifteenth-week 
session reliability on three sections of cadets 
gave a reliability estimate of .78 for a total 
of 68 cases (unpublished data). In both of 
these instances the trait of leadership was 
considered. Group ratings have also been ob- 
tained by a 7-point rating-scale procedure in 
which each man rated every other man in his 
section and himself on intelligence. This pro- 
cedure yielded within-session reliabilities of 
-86 and .89 at the fourth week and fifteenth 
week, respectively, and a between-session re- 
liability of .76 (3), 

The reliability of two methods of obtaining 
self-ratings may also be compared with the 
SPM procedure. A between-session reliability 
of leadership rankings (each subject was 
asked to assign himself a rank number within 
the total number of people in his section) 
was obtained for three sections of cadets. The 
average between the fourth- and fifteenth- 
week administrations for the three sections of 
cadets (total V of 68 cases) was .34 (unpub- 
lished data). The rating-scale procedure (each 
individual rating himself on a 7-point scale) 
ae a between-session of .19 for 95 cases 

The reliability findings may be summarized. 

he group-rating reliabilities both within and 

etween sessions for three methods are quite 

Comparable. The SPM procedure enjoys a 
considerable advantage in the self-rating re- 
liabilities between sessions. 

The comparability of the SPM procedure 
for group ratings and the peer-nomination 
Procedure was determined. The two alterna- 
tive procedures were used in the fifteenth- 
week sections in which SPM data of Table 2 
were obtained. The averaged correlation be- 
tween the group ratings obtained by the two 
Procedures was .80. In addition to the peer- 
Nominations the rank-order procedure for ob- 
taining self-ratings was also introduced at the 
fifteenth week for the eight sections. These 
rankings correlated .34 with the SPM self- 
rating ranks. 

The relationships between the measures ob- 
tained by the SPM procedure with objective 
Measures can be roughly compared with those 
relationships obtained by the rating pro- 
cedure on the variable of intelligence. This 
comparison, however, is only approximate in 
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Table 3 


Correlations Between SPM Method and the ACE and 
Rating-Scale Method and Otis for Group 
Rating and Self-Rating 


Group Self- 

rating rating 
SPM 46 -26 
Rating Scale .49 21 


that the object measure for the SPM method 
is the ACE and in the case of the rating-scale 
study, this measure was the Otis self-adminis- 
tering test (3). The data are given in Table 3. 


Summary 


Summary statements of the available sta- 
tistical data concerning the SPM procedure 
and its comparison to other methods can be 
given: 

1. The SPM procedure yields highly reli- 
able measures within sessions for both group 
ratings and self-ratings. 

2. The between-session reliabilities of the 
group ratings are high and the between-ses- 
sion self-ratings are respectable. 

3. The SPM procedure increases the reli- 
ability of between-session self-ratings when 
compared with self-ratings given by rank 
designation procedure or a self-rating on a 
rating scale. ; 

4, The group ratings obtained by the SPM 
method are considerably correlated with the 
peer-nomination procedure for group ratings. 

5. The self-ratings of the SPM procedure 
within sessions show only a limited relation 
with a ranking procedure. Comparing the be- 
tween-session reliability would favor the use 
of the SPM method. 

6. The group ratings show substantial and 
similar relations to objective measures when 
compared with those obtained by a rating 
procedure. 

7. Self-ratings show low and similar rela- 
tions to objective measures when compared 
with those obtained by a rating procedure. 

In addition to these statistical facts, a num- 
ber of “fringe benefits” may be cited for the 
procedure outlined in this paper: 

1. Measures of intrasession reliability are 
available for the self-ratings. 


e 


236 


2. Group ratings are obtained indirectly 
without the man being forced to name high 
or low extremes of his group or to rate indi- 
viduals extremely. 

3. The procedure is extremely simple to 
administer and requires a shorter time than 
the other procedures. It can be easily ad- 
ministered on mark-sensing cards or on IBM 
answer sheets. We use the later procedure in 
which each name of the class roster is as- 
signed an answer space and the rater marks 
answer space “a” if he considers himself su- 
perior for a given item (name-number) or 
“b” if he considers himself inferior., 

4. There is a common set for all subjects 
in the case of the self-ratings. For example, 
the other procedures permit the individual to 
rate as he thinks the others will rate him or 
as he thinks he should be rated. 


Wilse B. Webb 


5. The value of a trait to a group may be 


obtained indirectly by counting the total 


number of pluses assigned a trait by the 
group. Indirect measures of morale may ba 
obtained through such a plus-minus counting 
for the total group. 
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New Tests 


Bennett 
ae K., & Gelink, Marjorie. Short Em- 
Dev dielom ests (SET), 1956 Manual. New York: 
chological Corp., 1956. Pp. 11. 


The seco: sa 
Beebo zefi of the manual for the Short 
16, 159; 1953 aly (see J. consult. Psychol, 1952, 
tests with fob ant 401) contains correlations of the 
norms for job titeria in 19 business situations. The 
than 33,000 applicants are now based on more 
000 women and 9,000 men—L. F. S. 


Brow. 778 
D E F., & Holtzman, Wayne H. Brown- 
(SSHA) 1956 i of Study Habits and Attitudes 
Corp., 1956. Pp. seth New York: Psychological 


The revi 
high A A n contains technical data for 
(see J. consult Beyi as well as for college students 
Higlvachidoluasswell chol., 1954, 18, 153-154). At the 
shows tl as at the college level, the SSHA 
163i carralalion wi correlation with achievement, has 
to the N ith the ACE, and adds significantly 
piven £08 vole a Eo Percentile norms are 
from 3,500 Ha and high school groups, derived 
2,800 cases, respectively.—L. F. S- 


Buhler 
R Manson, Morse P. The Picture 
adolescent AlE: 2 sor projective technique. Child- 
of materials ($1 1 form. Untimed, (30) min. Set 
manual, p a for 25 administrations), with 
Angeles, ae y manual only ($3.50). West Los 
1956. .: Western Psychological Services, 
The Pic 
version Beale oe Test is essentially a picture 
explore how a cll-known World Test, designed to 
world, with fe ay perceives and structures his 
Ahe erame fies asis on his goal-setting activities. 
ateactared & presented with 12 small drawings of 
a chase of ae a large sheet of blank pape, and 
persons, vehicl anple symbols by which he can add 
He is asked a buildings, and animals to the scenes. 
wishes “to a choose any number of the scenes he 
lke it to bee e k a world as it is or as you would 
world of your the world you like or dislike; the 
sani ee dreams, . . P? The examinee gums the 
wishes, A tae blank sheet, connects the scenes as he 
i j s symbols, gives his world a name or 
E and tells a story about it. 
he manual describes methods for interpreting the 
world scenes and world stories. EA are ven 


on the frequencies of the main story ies i 

A d y categories in re- 
lation to age and quality of adjustment. Twenty- 
eight illustrative case studies demonstrate the clinical 
use and interpretation of the test. 

All in all, the Picture World Test seems to be 
an interesting and challenging instrument, likely to 
evoke self-revealing responses of consid ini 
eae a g siderable clini- 


Cureton, Edward E., Cureton, Louise 
Multi-Aptitude Test. For neiere od yoke 
and lay groups. 2 forms. 35 (50) min. Study kit 

with 2 test forms, keys, and manual, pp. 32 ($1 28 

ea., $9.00 per 10) ; test booklet separately, Tota. A 

or B ($3.50 per 25). New York: Psychological 

Corp., 1955. 

The Cureton Multi-Aptitude Test is unique. Not 
jntended for any practical purpose of measurement, 
it is designed to teach and demonstrate the nate 
of psychological tests to a wide range of interested 
persons. Advanced classes may use the test data for 
item analyses and studies of test intercorrelations; 
nonprofessional groups may satisfy their curiosity 
about what tests are. The 10 short subtests represent 
most of the common varieties of test item. Five 
parts—vocabulary, information, arithmetic, number 
series, and figure classification—are typical of group 
mental tests and also illustrate verbal, number, and 
reasoning factors. The remaining subtests—mechani- 
cal comprehension, word recognition, scrambled let- 
ters, checking, and paper form board—typify other 
abilities found by factorial studies and used in spe- 
cial aptitude tests. The keys acquaint students with 
various types of scoring devices. The manual is an 
excellent miniature specimen for instruction, with 


full tables of data and norms for practice, although 
ion. The test should be 


widely useful as an unrestricted instrument for in- 


struction, thereby sparing other tests whose security 
needs protection. —L. A 


Object Relations Technique. 
Individual projective technique. 1 form. Adoles- 
cent-adult. Average time (90) min. Set of 13 
plates, with manual, pp- x+ 224, cloth ($10.00) ; 
minal only ($6.00). Glencoe, Il.: The Free Press, 
1955. 

The Object Relations Test is a jecti 
method which bears some uation 10 he TAT, 
developed at the Tavistock Clinic at London Tt 


Phillipson, Herbert. The 
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novel features are its rationale which springs from 


Psychological Test Reviews 


ee S, 
ardson formula 21 range, in single-grade groups, 


.91 to .95 
a theory of personality, and its stimulus pictures * from .72 to .92 for the subtests and from 


which were designed so as to vary certain impor- 
tant characteristics systematically. The test’s name 
and intent come from the psychoanalytic theory of 
unconscious object relations which exist within the 
personality, were derived from the individual’s re- 
lations with significant persons in his earlier life, 
and in turn determine his relationships with the 
real people in his present external world. 

Twelve of the pictures—the thirteenth is a blank 
card—are divided into three series of four plates 
each. The series vary in degree of Structure, from 
vague, hazy figures and backgrounds in series A, to 
detailed, realistic backgrounds in series C. In all se- 
ries, the human figures are ambiguous as to sex and 
lack facial features. The four cards within each se- 
ries represent one figure, two figures, three figures, 
and a group. Administration is similar to that of 
the TAT. The cards are not shown in serial order, 


but in a designated order which mixes the series and 
the numbers, 


The accompan: 
which the test i 


may well prove to be a maj 
jective methods—L, F S. 


3 set, $24.50 
; 2 IBM an- 
ansparent profile 
0S Angeles; Cali- 


swer sheets (4¢); 
sheets (2¢); sample set ($1.75). L 
fornia Test Bureau, 1955. 
The Multiple Aptitude Tes 
of differentiated tests for hi 
college freshmen, The nine subt 
paragraph meaning, language usa 
arithmetic reasoning, ari i 


t offers anothe 
igh 


» and spatial, 
full data, altho: 
Reliabilities by 


for the factors. Validity is discussed in nus of m 
factor analysis, correlations with other tes Sy aie 
correlations with school marks in 18 Lala gels | 
norms, obtained on a nationally distribute ee 
of over 11,000 cases in grades 7 through 13, as ye 
pressed as standard scores and percentile ra 
ach subtest. re 
° The data in the manual reveal a zambit pi 
esting strengths. Good attention is paid to an ane 
ard errors of differences between scores, an aaa 
are cautioned against drawing conclusions “an ioe 
significant differences. An examinee’s test pro meret 
be compared with those of high and low oi a 
in each school subject, and expectancy ta on the 
Provided which relate school marks to scores 
most predictive subtests. TTR, 
There are also some weaknesses. Most ee 
the fact that all norms and interpretive oak ite 
given in terms of the nine subtest scores, W ae ig- 
more reliable combined factor scores are amo the 
nored. The manual gives little information ae sub- 
selection of content and the development of t C Why 
tests. The data also disclose some pep ‘i 
is the arithmetic computation subtest caer re 
best predictor of grades for general mathema es 
general science, but also the best or close nex m 
for English, foreign languages, social ae 
Psychology? Such an observation casts eee 
on the value of the tests for differential ee 7S 
in comparison to a single predictive score.—L- 


Wagner, Mazie E., & Schubert, Herman J. P Den 
P. Quality Scale jor Late Adolescents and fag 
Adults. Buffalo 22, N. Y. (State Universi 1955: 
New York College for Teachers): Authors, 

Pp. 23 + 28 plates. $2.00. 


al 

A long-established way to evaluate a ee 
Product globally is by the use of scaled pam 
for comparison. Wagner and Schubert have pro nal? 
four scales for rating drawings of a pera tee 
and female figures, drawn as front and side V that 
Data in the accompanying monograph show pility 
trained raters can use the scales with high relia! an 
(> .90), that novices can learn to rate quickly rated 
that examinee retest reliability for drawings 5o aw“ 
is 85. Most interesting is the evidence that the jon 0 
ing scores contribute significantly to the predicti cor- 
scholarship in a teachers’ college, and have OF aoi 
relations with other predictors. The findings Tr 
that the DAP may be used to predict the achi it 
ment of young adults, just as Goodenough use anit 
to predict the achievement of young children sa 
years ago. The scales also demonstrate the pai - 
Which come from applying sound quantitative aa 
ods to the over-all appraisal of a complex pers 
Product.—L. F, § 
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Validation of the Lowenfeld Mosaic Test* 


Monroe L. Levin 
Teachers College, Columbia University ? 


Th M 
was cfu upon which this report is based 
the et te by Personal experience with 
sion that it est which had led to the impres- 
Although fence a useful clinical instrument. 
clinical pr bl test has been applied to many 
numerous po and has been endorsed by 
the ledom icles, a critical review revealed 
inconsistent. = be contradictory, diffuse, and 
as scoring reli urthermore, such basic issues 
dation of hy iability and experimental vali- 
quately j ypotheses had never been ade- 
y investigated. 


Method 


The 

Test a set of the Lowenfeld Mosaic 
ing to the imei to all subjects accord- 
mended for u andardized instructions recom- 
jects were (enn this country (18). AN sub- 
twenty ae a to a performance time of 
tographed oe The final Mosaics were pho- 
Fim siea 25 mm. Type A Kodachrome 

8 color transparencies which were 


readily exami 
jector. ined by means of a slide pro- 


Hypotheses 


Hypot! : 
of het he in the form of statements 
saic sign would ich stated that a given Mo- 
in the apenn significantly more often 
Hypotheses w ental group being examined. 
pected to di ene formulated which were ex- 
o differentiate between: (a) institu- 


1B 
Goes ae a doctoral dissertation submitted to 
to A kor Ba we in 1954. The author is jndebted 
Solomon for th F. Shaffer, E. J. Shoben, Jr. and H. 
search was r their assistance and guidance. The re- 
search apa ee while the author was a Re- 
Health, United the National Institute of Mental 
2 Currentl ed States Public Health Service. 
tan Gane F Western State Hospital and Chris- 
Kentucky. y Mental Health Center, Hopkinsville, 


tional and noninstitutional groups, (b) be- 
tween normals and all other subjects, (c) 
between “maladjusted? and normal subjects 
(d) among six diagnostic groups, and (e) 
between subjects with high scores in the clus- 
ters obtained from the Wittenborn Psychi- 
atric Rating Scales and those with low scores 
in the same clusters. Hypotheses were also 
tested which had been suggested or inferred 
by Lowenfeld and Wertham but which had 
not been originally included in the study. 
Most of the hypotheses were based on the 
published Mosaic literature. 


Institutional and noninstitutional groups. The Mo- 
saic Test has been regarded as a Gestalt instrument 
which reflects the functioning level of the individu- 
al’s cognitive and emotional processes in concrete 
situations (16, 21). Since the incoherent Mosaic is 
by definition the most disorganized response to the 
test, it was anticipated on an a priori basis that in- 
coherent designs would occur much more frequently 
in institutional groups than in  noninstitutional 

to function in society, re- 


groups which are able 
gardless of diagnostic considerations. It was there- 


fore hypothesized that when the institutional groups 
were compared with the noninstitutional groups, in- 
coherent designs would be found to occur signifi- 
cantly more often in the former group. 

Success and adjustment. It was anticipated that 
when normal and pathological groups were com- 
pared, unsuccessful designs would occur more fre- 
quently among the pathological groups since lack of 
success has generally been regarded as a gross sign 
of psychopathology (2, 6, 10, 12, 16, 17). It was 
also anticipated that the proportions of occurrence 
would be such that the sign could be used in mak- 
ing jndividual discriminations. 

“Maladjusted” vs. normal subjects. Subjects who 
were functioning in society were divided into “nor- 
mal” and “maladjusted” groups on the basis of 
scores on the Cornell Index (Form N2). Since the 
“maladjusted” group was heterogeneous, it was impos- 
sible to develop hypotheses which could have been 
expected to identify a majority. It was possible, 
however, to select Mosaic characteristics which had 
been regarded as being indicative of the presence of 
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a wide variety of emotional disturbances such as 
might be present among the “maladjusted” group. 


Twenty characteristics were selected. It was rea- 


soned that if the twenty signs have utility in dis- 
criminating between better and less well adjusted 
socially functioning individuals, they would occur 
significantly more often among the “maladjusted” 
group. The signs which were selected as hypotheses 
and the sources for each are given in Table 2. 

After the data were analyzed, it was decided to 
determine whether, as anticipated, “maladjusted” 
subjects produced more of the individual signs than 
did normals: i.e., whether the sum of the signs was 
discriminative. 

Diagnostic groups. In formulating hypotheses for 
the diagnostic groups, signs were combined to form 
a multiple hypothesis when they could be expected 
to occur in about the same Proportion of the sample. 
Experience with the Mosaic Test was relied upon to 
construct final hypotheses which seemed most likely 
to yield positive results. The specific hypotheses and 
their sources are given in Table 3. The hypothesis 
that psychotic subjects would use fewer pieces than 
nonpsychotic subjects was also tested. 

Wittenborn cluster groups. Since the Mosaic litera- 
ture rarely differentiated between 
neurosis or psychosis, 
Procedure for assignin| 
born clusters. It was 
signs of neurosis and 
and “psychotic” 


been gathered, 
spectively, 


Subjects 


ferential diagnosis, 
the first criterion wi 
formance was com; 


$ A E and 
“maladjusted,” four Institutionalized groups 
were included in the study. The institutional- 


Monroe L. Levin 


ized groups consisted of diagnosed neurotics, 
familial mental defectives, general paretics 
ith psychoses, and schizophrenics. hee. 
ei of the unreliability of psychiatrie 
diagnosis, the Wittenborn Psychiatric Rating 
Scales were used to select groups for the sec 
nd phase of the research. š 
j me criteria. All subjects were vak 
males between the ages of twenty-one a, 
fifty-nine. Fourteen of the normals, three A 
the “maladjusted,” four of the neurotic, oa 
of the paretic, and one of the schizophren! 
were foreign born. 


All of the noninstitutional subjects were a 
ing in society at the time of testing. They tion 
drawn from a variety of residential and ake was 
settings in New York City. The group WEE done 
defined as normal consisted of those gonis Index 
alized persons whose responses to the Come 5 with 
(Form N2) resulted in scores of twelve or les: amal- 
no “stop” items, while the group defined as es on 
adjusted” consisted of individuals whose scor Jevel. 
the Cornell Index exceeded the assigned cutoff his- 
Persons whose indices revealed that they et 
tories of mental illness, ulcers, convulsions, on the 
drug or alcohol addiction, were dropped fro! y a 
study, and those known to be ii P OA 
the time of testing were also excluded. ad 

None of the institutionalized subjects had oe m 
a previous diagnosis which conflicted with eee 
rent one: eg., none of the neurotics or her 
had been previously diagnosed as being pay ere 
With the exception of some of the neurotics, uacy 
was no staff disagreement concerning the mee 
of the diagnoses, It was necessary to EEO n fO 
differences and use the official diagnoses in or E 
obtain a sample of diagnosed neurotics. It is 
sible that some of the neurotic subjects were in 
initial stages of psychoses. 


05-7 
the 


Subjects in the general paretic group u 
had no history of mental illness prior to the 
Onset of leutic symptoms, and none of te- 
familial mental defectives manifested me 
worthy symptoms of emotional disturban 
There were 52 normal, 14 “maladjusted, 


t 5 

neurotic, 34 defective, 29 paretic, and , 

schizophrenic subjects. p35 
It was possible to obtain ratings ° 


Schizophrenic, 29 general paretic, and 10 oer 
Totic subjects on the Wittenborn Psychia ve 
Rating Scales. Groups were selected to rep i 
Sent the upper and lower extremes of © 
Wittenborn symptom cluster by means cts 
Scores on each of the nine clusters. Subjee. 
at the lower end (least pathology) of €% 
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cluster were compared with subjects at the 
aed end (most pathology) of that cluster. 
ecause of sampling difficulties, two sets of 
amples were selected from the upper ends of 
ea the Wittenborn clusters: a smaller 
tiene in which the extremes of pathology 
hs ag marked, and a larger sample in 
e extremes of pathology were some- 

what attenuated. 
to pnavaitalled variables. It was not possible 
Status rol the variables of socioeconomic 
ttem, eee, age, and ethnic origin. 
tion ig were made to avoid overrepresenta- 
though | one socioeconomic group, al- 
marily q saie Test responses are prl- 
istics on RIEA By personality character- 
major socioeconomic status should not be a 

here cen of test responses. 
ental or been a consensus that, after the 
Unimpo a of eight years, age is a relatively 
rtant factor in Mosaic performance 
Conversely, it might be stated that 
8-0, intelligence is a relatively un- 
erp von in Mosaic performance. It 
Uncontrolled to allow intelligence to remain 
aining ac because of the difficulty of ob- 
Pathologic] e measures from certain of the 
intellige ca Samples, Tt seemed likely that 
A mpared ; would be a minor variable when 
Sampling with personality, particularly since 
Wide ran methods probably resulted in a 
8toup Mie of intelligence levels among every 
oe mentally defective one. 

uxiliary studies demonstrated that 
Control of the variables of age and 


te gee 
Sults (yn did not seriously affect the re- 


Wo 
lack 


Scop; 
“Oring Method 


n ` 
Storing Pieliminary experiment, a method for 
Stori 8 ar characteristics was devised. 
rain a Mosaics by three independ- 
ti Portions judges and the author yielded 
tisticg of agreement on Mosaic charac- 
Chance Which ranged from .45 to 1.00. 
= Pe alone would have yielded a ratio of 

‘fect agreements in any instance. Ad- 
tests of concordance revealed that 


ed that the method for scoring “0 
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saic characteristics was teachable and re- 
sulted in high interjudge agreement. 
Steps were taken to eliminate bias in scor- 
ing of the Mosaics in the research proper. To 
determine whether bias had been successfully 
controlled, and to re-examine scoring reli- 
ability on the research data proper, a lay- 
man was trained to score Mosaics. She then 
scored the 20 Mosaics considered to have 
been most difficult to score. Percentages of 
agreement between the layman judge and 
the author ranged from 75 to 100 per cent 
on the hypothesized signs. In every instance 
the obtained agreements differed significantly 
from chance expectancy. It was concluded 
that bias in scoring had been successfully con- 
trolled and that the reliability of the devised 
method of Mosaic scoring was independently 
reconfirmed (8). 
Reliabilities of combinations of signs. Most 
of the hypotheses consisted of several signs 
used in combination, while the reliability data 
were based almost entirely on single Mo- 
saic signs. Although the multiple hypotheses 
should have lower scoring reliabilities than 
the individual signs, the scoring reliabilities 
which were obtained were so high that it was 
assumed that the combined signs would have 
satisfactory scoring reliabilities. 
Statistical Methods 

Frequencies of occurrence of hypothesized 
signs were often so small that minor changes 
in frequencies could have seriously modified 
the statistical conclusions. The 1 per cent 
level was set as the criterion of statistical 
te he effects of chance 
significance to offset the 

ling fluctuations. —— 

pay method. Values of Vx°/N were 
computed in those cases where mbien m 
not selected independently of each other. the 
method was appropriate for examination of 
results obtained when Wittenborn cluster 


Table 1 


Notation Used in Descriptive Analysis of Data 


Wittenborn Cluster Score 
So ere 


Sign Low High 
Josaic sign absent A B 
Mos: C 5 


Mosaic sign present 


242 Monroe L. Levin 


Table 2 


Frequencies of Occurrence and Values of for Twenty Signs of Maladjustment 
When Maladjusted and Normal Groups are Compared 


Maladjusted Normal š 
Item References f f ai 
1. Edge 3, 7,9, 10, 14, 16, 17, 19 3 i = 
7,9,10 0 S 
2. Corner 19, x 3 51 
3. Frame 1, 7, 9, 10, 14, 16, 17, 19 2 : - 5! 
4. All-over 2, 3, 16, 17, 19 1 3 —1.6 
5. Well-defined cross 9 0 0 0 
6. Supersymmetry 2, 6, 16, 17 0 a 
7. Active C rejection plus emphasis 11 1. 
on F 2, 16, 17 6 ] -132 
8. Emph. on C without emph. on F 2, 16, 17 0 14 2.51 
9. Unsuccessful 2, 6, 10, 16, 17 9 9 
10. 40% or more black in comb. with 0 1. 
other Cs. No others preponderant 9, 14, 16, 17 1 
11. 40% or more black and blue in 78 
comb. with other Cs. No others 13 3 
Preponderant 16, 17 5 6 E 
12. 40% or more red 16, 17 0 3 E 
13. Serrated red edge 9 1 i. 2 
14. Superimposition of stones 2, 14 0 4 - 
15. Attempted edging 2 0 1 16 
16. Winged designs 7,9, 16, 17 0 == 4 
17. Downward arrow 19 1 5 0 2 
18. Repetitive simple design 2, 16 0 0 -1.6 
19. Formation of letters of alphabet — 0 3 
20. Use of full 20° with resultant wat 1.32 
Successful design ai 0 2 
i ` g -e analy” 
aps were examined. The notation used is twelve of the latter subjects. Arc sine sgicat- 
Sedat Tablet, sis of the data yielded a z of — 1.08, 
ETAT —_ 277 1 ..:—— 
VX/N = VU- DAF Dy 
was the statistic which was used The closer 
the value of xX?/N to 1.00 


» the better the 
ittenborn Scales and 
ing individuals who 
w the clusters of be- 
‘onsidered, 


Results 


Analyses of the data revealed that 
hypothesis functioned eden 


as anticipat k 
though some signs which P a 


: por" 
ing that the data clearly failed to SUP 
the hypothesis being tested. 


Success and Adjustment f 
nt 0 


In scoring for “success” both the inaction 
the subject and his final Mosaic a this 
were scored, In all other instances “dere 
study, only the final product was ge of 

Ourteen of the 52 normal subjects an sub” 
the 126 less well adjusted and ondor ruling 
jects produced unsuccessful designs, al dat? 
in a z of 5.67, Although the Stat at ws" 
strongly supported the hypothesis tha mond 
cessful designs occur most frequently Pacts) 
Poorly adjusted and poorly endowed ee: at 
the frequencies of occurrence were Sy GIE 
the sign would not be useful in making 
vidual discriminations. Since success ae atio” 
of success have perfect negative Po sup: 
by definition, the statistical results 4 ih ul 
Ported the implicit hypothesis that suc 


we N 


>, a 


ad 
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Sieh occur most frequently among well en- 
Owed, well adjusted subjects. 


e n 
Maladjusted” vs. Normal Subjects 


n results obtained by comparing the per- 
"ances of normal and “maladjusted” sub- 
e are summarized in Table 2. None of the 
a of maladjustment discriminated be- 
the 1 normal and “maladjusted” subjects at 
feet per cent level of significance. A subse- 
ma ier ge of the data revealed that nor- 
Of mag ects Produced a mean of 1.73 signs 

aladjustment, and “maladjusted” sub- 
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jects produced a mean of 2.07 such signs. 
Since the standard error of the difference be- 
tween means was .3 and ¢ had a resultant 
value of 1.12, it was concluded that the num- 
ber of signs produced by normal and “mal- 
adjusted” subjects did not differ significantly. 
The latter finding is in need of cross valida- 
tion, since the hypothesis was not formulated 
in advance. 


Diagnostic Groups 


Examination of Table 3 reveals that none 
of the hypotheses relating to the diagnostic 


Table 3 


Frequencies of Occurrence, Tests 0 


Signs Related to Di 


f Significance, and References for Hypothesized 


jagnostic Groups 


Comparison Groups 


Exp. Group 
ee. 
Sign References Neurotic Defect. Paretic Schiz, Maladj. Normal 
Comer 
0 0 1 0 0 1 
pial 1 pan 0 —1.15 0 0 — 92 
Frame 
1 1 0 1 2 3 
9; 10,16 f == 62 165 63 62 18 
Cross ö 1 1 2 0 5 
3 í = -ios -115 —-153 0  —162 
10% or 
` m ‘ x 1 0 3 1 0 
mta athe z ie incomb. 9, 14, 17 f kid Awe n i8 -142 0 
©Ponderan; o others 
errate, 0 2 1 1 0 
“red edge s16 f = o 163 -149 -142 0 
Win 0 0 0 3 
Sed design 7,919 f 1 ' 7 165 171 142 18 
i ene a r, 
Defect. Neurotic Paretic  Schiz. Maladj. Normal 
Unemben: 1 0 0 1 
bellished fundamentals 9, 19 $ a a L43 142 108 29% 
Simple a... 24 23 7 15 
Pie design 9,131519 f 3 sp i 1.04  3.05*  6.36* 
No, x 0 0 0 0 
S : 0 
designe ed simple compact 9,13, 15,16,17 f ki 1.9 2.38 2.5 1.9 2.73* 
Repetj F 0 0 0 0 0 
tones design of paired 9, 19 f Š 19 2.38 2.5 1.9 2.73% 
Enum 5 1 5 4 1 0 
erative use of color 16, 17 f ag 1.27 34 1.05 127 1068 


*D 
‘ference significant at 1% level. 
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Table 3—Continued 
Exp. Group Comparison Groups 
i - i 
: i Ialadj. Normal 
Sign References Paretic Neurotic Defect. Schiz. M 6 6 
- 7 0 12 8 2.87* 
Unsuccessful, sinpi des, C 2,12, 16,17 f n ane “a 1.36 —.32 
used indiscriminately 1 2 
1617 y 4 0 3 Sa a ig 
Inappropriate use of shape 12, 16, 17 J $ er 63 3.03 k 
: rmal 
Schiz. Neurotic Defect. Paretic Maladj. No! 
11 
16 6 4 
Emph. on F with active C 2,6,16,17 f 12 B 13 zi 122 —.56 1.3 
rejection z = : i ji 
1 2 83" 
Supersymmetry 2,16,17 f 6 3 hig 19 2.71* 3 
7 F 0 
0 0 
W. tray covered by complex 2 f 0 ? 0 0 
incoherent des, begun within z = 
10” i 
j 0 0 _ 88 
Edging 2 ¥ 0 ` R x 0 8 
p 4 
0 
Superimposed stones 2 f 6 m m tg 271% 1.32 
z p ó 
0 
Repetit. simple des, with 16 f 0 0 0 . 0 0 
same shape Tepeated, varia- z — 0 0 71s 
tions in C ‘ 
3 
Abstract des, redominate 16, 17 5 9 10 —1.2 
: ‘ bs 218 -202 -194 —1.17 
* Difference Significant at 1% level, 


ard deviation of 43.87; 
jects used a mean of 28, 
standard deviation 
jects used a mean of 32, 


Table 4 Summarizes the data relative to 
the Wittenborn cluster groups. Although ex- 
aminations of Columns l and 2 demonstrate 


denti 
that the Mosaic Test usually correctly id the 
fied individuals who did not ee, eT 
Symptom correlates of the a the tes 
Sons of Column 3 and 4 show Eil 
Hy identified individuals who dem with th 
© extreme behaviors associated E/N com 
Wittenborn clusters. Values of Vx nd 4 i” 
puted from the data in Columns Wittenbo® 
dicate that the Mosaic Test and V eent j 
Cales were generally in good a8 nologie A 
identifying pathological and e not ©, 
individuals, but this measure di where nl 
Sider instances (Columns 2 and 3) ticipate” 
Mosaic Test failed to function as ‘data in ° 
ere it possible to include all the blé the 
Statistical computations, it is pro veal tb 
tests of the null hypothesis would tet 
the Mosaic Test functioned no be the P” 
chance in identifying individuals on 


le 
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sis of absence or presence of the behavioral 
correlates of psychopathology. 

Comparisons of both sets of data in Table 
4 indicate that the results were relatively un- 
affected by changes in characteristics of the 
Samples. The slight decreases in values of 
Vx°/N which resulted from lowering cutoff 
Scores may have been due as much to in- 
creased sample size as to heightened similar- 
a s samples, and are not the changes which 
w u be anticipated if the Mosaic Test signs 

ere highly sensitive. 

hen the reaction times of the depressed 
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cluster group were compared with all other 
cluster groups and the normal and defective 
diagnostic groups, it was found that the 
ranges of reaction times among the several 
groups were such that individuals in every 
group overlapped with members of the de- 
pressed group. Reaction times of several 
groups were as slow or slower than those of 
the depressed group and when tests of sig- 
nificance could be conducted, no significant 
differences were found. The findings remained 
the same when Wittenborn cutoff scores were 
lowered to increase the sizes of samples at 


Table 4 


Occurrence of Hypothesized Mosai 


ic Signs and Values of Vx2/N for Upper and 


Lower Ends of Wittenborn Cluster Groups * 


Lower End Upper End 
Cluster 1. Sign 2. Sign 3. Sign 4. Sign 
Toup Sign References Absent Present Absent Present  Vx2/N 
Acute anxi 5 1 75 
xiet i 6,17,19 28 11 ge 
y Edge design 12, 14,1 (8) a) (oO) (3) (.69) 
; A 1 6 0 92 
Corner design 9, 10 68) (1) (10) (0) 88 
1 6 0 92 
40% o black i 9, 14 s 
cate al tor Gh 6 W U O 
No others preponderant 
Conversi 12 0 86 
e ; 36 1 : 
ysteria Frame design 10, 17, 19 (36) (1) (12) (0) (.86) 
g 11 1 17 
ee 32 > zs 
es absent or 1 (32) (5) (11) (1) (.77) 
Manic 2 20 2 ER 
depressed” Emphasis on C without 16, 17 eH (2) (25) (2) (.78) 
States emphasis on F 
Manic 2 4 0 94 
State 40% or more red 2, 16, 17 a (2) (9) (0) (.9) 
1 4 0 95 
Red projections make up 2, 16, 17 an a) (8) (1) (.88) 
50% or more of all pro- 
5 jections 
epre 
State ped Slower reaction time than 2 
other groupst 
. f : 17 61 2 20 2 F81 
Emphasis on C without 16, (61) (2) (20) (2) (81)9 


emphasis on F 


at upper 


*D, 
ata i P i i 
data are sana Parentheses obtained by lowering, atone © possible) to obtain a larger sample by lowering cutoffs. 


ata gonit Was not necessary (or in some instance: 
ummarized in text of article. 


ends of clusters to obtain larger samples. Where both sets of 
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Table 4—Continued* 
Lower End Upper End 
; = i . Sign 
Cluster 1. Sign 2. Sign 3. Sign 4 aN 
Group Sign References Absent Present Absent Present Vey 
.29 
40% or more black plus 16, 17 12 4 13 5 (.29) 
blue in combination with (12) (4) (13) © 
other Cs. No others pre- 
ponderant 
Downward arrow 19 14 2 18 0 (64) 
(14) o (18) (0) $ 
Phobic Use full 20’ to make co- 3 50 2 7 0 (37 
compulsive herent unsucc. all-over (50) (2) (14) (0) i 
design 
Schizophrenic W, tray covered by com- 2 11 0 12 0 Co) 
excitement plex incoherent des, be- (11) (0) (12) (0) if 
gun within 10” 
Paranoid Small slab 16, 17 38 0 4 0 (52) 
condition (38) (0) (7) (0) C 
Formation of letters of -n 94 
37 1 4 0 91) 
alphabet (37) ú) (7) (0) (¢ 
Paranoid Supersymmetry 2, 16, 17 9 
i i , 16, 19 2 7 0 69) 
schizophrenic (19) (2) (12) (1) iG 
Repetitive simple des 16 85 
i 20 1 7 0 7) 
same shape repeated (7 
with variations Coke (20) a (13) ) 
Hebephreni i i i x 4 
ee, Simple incoherent design 2, 5,6, 16,17 26 3 7 2 (a) 
(26) 3) a3 @) 
Edging 2 29 0 9 0 a 
(29) (0) (16) (0) > 


Superimposition of stones 


2 28 1 ya ? (6 
(28) (1) (13) 3 
* Data in Parentheses obtaj; i : 
data are came, it was not neces a in conn cutoffs at te Suis oF i 3 
5 I, r 


Lowenfeld’s and Wertham’. 


S Signs 


Discussion 


The overwhelmingly negative results juste 
the conclusion that the Mosaic Test can fer” 
used in its present form as a tool for di n 
ential diagnosis. It may be argued that miaa 
of the signs were modified for incorpora sy 
into the study and that a molecular Ta the 
than a global approach was used. yea 
Signs suggested by Lowenfeld and wera 
which were tested separately from the ™ 
data also failed to function as anticip a is 
regards a global approach to Mosaic a” 


— 
ee 


a 
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Table 5 
Lowenfeld’s Signs Not Used as Hypotheses 


Exp. Group Comparison Groups 
Sign References Neurotic Defect. Paretic Schiz. Maladj. Normal 
Unsuccessful 10 5 28 26 21 9 14 
z == —3.14* —3.17* —1.56 —1.53 63 
S 
lab 17 f 0 2 3 3 0 1 
z — —1.55 —2.01* —1.89 0 —.92 
Defect. Neurotic Paretic Schiz. Maladj. Normal 
No. small 
ag 3 8 0 0 4 0 0 
simple designs 2 Í = 3.19* 4 1.34 3.19* 4.58* 


* Di 
Difference significant at 1% level- 
Table 6 
Wertham’s Signs Not Used as Hypotheses 


D Cle 


Comparison Groups 


Exp. Group 
ERTE . . : 
T Sign References Neurotic Defect. Paretic Schiz. —_ = 
15 1 
bho, More black 3 13 3 
e in comb. with sabe iad l — —1.17 94 -148 BE 28 
T other prepon- 
40! 0 6 
% or more red 16 f 0 c a ies ð Ea 


Defect. 
No, S 7 ; 
< gegen a ae 
one * Se des., each of © 17 $ 4 a = hss 7 Oye 
mt j 0 0 
tine 0 0 
Pact, successfat com- 16, 17 f o 4 9 0 p 
Smal ; > : 
1 
ie ou f š 109 0 1.36 1.09 1.56 
Em z : 
aoa sal 1 8 
ri 20 
mph on gom without 16,17 f 2 133 4 154 138 207 
Use of 
i 0 A 1 
Breen D n white, or 16 f i O te 7 
tose ; 0 0 
alone and white used 16 f 0 o 0 0 0 i 


eo ee a a 


* Dif 
erence significant at 1% level, 
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sis, careful examination of the literature re- 
veals that in spite of statements to the con- 
trary, discrete molecular signs are those most 
frequently presented as having diagnostic 
significance. 

It seems likely that when the Mosaic Test 
is used by experts in a clinical setting, many 
cues which are not directly related to Mosaic 
performance are used. The source of these 
cues may be erroneously identified as the 
Mosaic Test, rather than the interview aspects 
of the testing situation. 


Summary 


This paper is a Teport of an experimental 
validation study of the Lowenfeld Mosaic 
Test. The method of group comparisons was 
used to determine whether there is justifica- 
tion for using the Mosaic Test in its present 
form as a clinical tool, Mosaic signs were 
Psychiatric diag- 
nosis and scores on the Wittenborn Psychi- 


he _ testing Situation, 
osaic Test itself, 
Received October 6, 1955, 
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Plausibility and Depth of Interpretation 


Seymour Fisher * 
Walter Reed Army Institute of Research 


k n = persistent problems in attempt- 
a scientif, 4 the psychotherapeutic process in 
general “St ly objective manner lies in the 
erms ie psychiatric terminology. 
ference,” « as “emotional insight,” “trans- 
but a few. unconscious hostility”—to mention 
ceptable —are difficult to translate into ac- 
Tieasired. “acd oas by which they can be 
ments are nd until satisfactory measure- 
cept (ie, available, the meaning of a con- 
other yari; its empirical interrelations with 
Preci iables) cannot be determined to any 
Ort degree. 
are 1itPretations,” both explicit and implicit, 
Pycha a 2 play a major role in many 
analytical a. particularly those which are 
inter y oriented. Operational definitions 
tory (e pretations have been fairly satisfac- 
sonably 1 5, 11, 12), in the sense that rea- 
tained ee interjudge agreement can be ob- 
Other cla separating “interpretations” from 
Question ps of therapist statements. The 
statements, the “depth” of interpretative 
little re S, however, has received relatively 
cept jg earch attention, although the con- 
literatur extremely prevalent in therapeutic 
Way et a Studies by Collier (1, 2) and Har- 
toward a 1 (7) have made preliminary steps 
Measure olving some of the problems 1m the 
er Ment of depth, but the meaning of 
5 m remains vague and obscure. 

tives: Ta study had two primary objec- 
cerning a to obtain further information con- 
Tatings e measurement of depth when the 
trolleq were made under fairly well-con- 
Conditions; (b) to make some intro- 

1 
and. fe Wtiter wishes to acknowledge the technical 
Ella eo se assistance of Irvin Rubinstein am 
Was p ilcox. An abbreviated version of this study 


resented A Sey 
t ed at yi Associa 
ion, Marc 3 TA Eastern Psy chological 


ductory exploration into the meaning of the 
term by comparing “depth” ratings with in- 
dependent ratings of the same interpretations 
based upon a concept of “plausibility.” It 
was hypothesized that judgments relating to 
depth of interpretation are implicitly derived 
from (and hence should be correlated with) 
the rater’s subjective estimate (i.e., predic- 
tion) of how “plausible” the interpretation is 
to the patient: deep interpretations will be 
considered more “implausible” than shallow 


interpretations. 
Method 


The basic procedure consisted of obtaining 
ratings of interpretations under a number of 
different conditions. In order to control cer- 
tain variables (which will be elaborated at a 
later point), the present design included the 
following aspects: (a) all interpretations were 
presented out of context, with the patient’s 
responses omitted; (b) the ratings were made 
from the framework of a single patient whose 
general personality structure was made known 

nd (c) the raters were asked 


to the raters; a t 
to assume that all interpretations were made 


at a constant time period in therapy. 


Statements 

Sixty therapist statements were selected 
from (a) recorded protocols, (b) published 
interviews, and (c) some were constructed 
fictitiously. These statements were all consid- 
ered to be “interpretations” in accord with 
a definition adapted from Porter (11) and 
Snyder (12). In choosing the final 60 inter- 
pretations, an attempt was made to include 
samples which might be expected to cover 
the entire range of “depth.” 

A fictitious case history and Rorschach 
summary were composed, and the wording of 
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the interpretations was occasionally modified 
to “fit” the history. The interpretations were 
then presented to the judges to be rated 
within the framework of this hypothetical 
patient (although the judges were not in- 
formed that the patient was fictional). 


Rating Instructions 


Two sets of instructions were drawn u 


one referring to “depth,” the other to “plau- 
sibility.” 2 


Depth. The instructions included the following di- 
rections to the judge: (a) he was requested to rate 
each of the 60 interpretations on a dimension of 
depth, “in the usual sense of the term”; no further 
definition was offered; (b) he was informed that all 
interpretations were made to the same patient, and 
that an abbreviated case history and Rorschach 
summary of the patient accompanied the list of in- 
terpretations; (c) he was asked to assume that all 
interpretations were given during the first three 
hours of therapy; (d) each interpretation was to 
be rated on a 7-point scale: a rating of 1 indicating 
an extremely shallow interpretation, i 
that one can hardly consider it to be int 


nature”; a rating of 7 indicating the “deepest Pos- 
this patient.” Fermada 8p 

Plausibility, These 
the “depth” 
(a) the term “interpretation” 
stead, reference Wi 


of view: Do thi 
this particular patient?” (c) 


5 No. 4813 from ADI i 
tions Project, Photoduplication Se i T 
Congress, Washington 25, D. ey Temitting in ad- 
vance $1.75 for microfilm or $2.50 for Photocopies 
ief, P hotoduplication 
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ratings were made by 10 psychiatrists, aa 
of whom had a minimum of 500 hours a 
therapy experience; (b) depth rannas ye 
made by 10 professional psychologists, e y 
having a minimum of 150 hours of pee 
experience; (c) plausibility ratings were i T 
by a comparable group of 10 professiona Pie 
chologists; (d) plausibility ratings were ‘brat 
by 10 psychology graduate students t A. 
and second-year students without the me 
degree), none of whom had any therapy 
perience, ; 

The experienced judges were deliberately 
selected from different geographical mcr 
to minimize personal friendship and sim 
training among raters. x j 

It wil be ted that no psychiatrists v 
asked to rate for “plausibility,” since it rate 
considered highly probable that oe stil 
ing instructions they would most like y eri- 
be rating for depth. Similarly, no ee 
enced graduate students were asked A 
for “depth,” since one would not expect ft 
to have any notion as to the meaning 0 
term. oa f 

In Table 1 the salient characteristics 9 
the four groups of raters are sutgmanse hs 
is clear that the psychiatrists, psycholog re 
and graduate students differ primarily a in 
Spect to therapeutic experience, haa 
addition the graduate students tend sonals: 
Somewhat younger than the proles aua 
Thus, it should be kept in mind that alt oe 
the groups will hereafter be referred adv 
“psychiatrists,” “psychologists,” and “st ups 
ate students,” differences among these f° 
should not be attributed too literally reall ; 
different roles; it is believed that, essent! 


Table 1 Hours 
Median Age, Hours of Therapy Experience, and 
of Personal Therapy of the Four Groups 
(W = 10) of Raters 


Hours of sof 

therapy Personal 

experi- apy 

Raters Instructions Age ence — 

Psychiatrists depth 32.0 2,275.0 76.0 

Psychologists depth 32.5 490.0 Jo 

Esvchologists plausibility 330 4300 0.0 
tad. students 


plausibility 25.0 0.0 


| 


| 


PA 
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these groups represent points along a dimen- 
sion of therapy-experience. 


Results 
Depth Measurements 


If there is any common meaning attached 
to the term “depth” one would expect to ne 
significant intercorrelations among the judges 
who rated the 60 interpretations. The median 
"6 (N =45) for the 10 psychiatrists was 
69 (Qi = .61, Qs = .74), and for the 10 
Psychologists .78 (Qi = 72, Qs = 83). Obvi- 
ously, then, the raters were employing com- 
a criteria in judging the “depth” of the 
fone Since the distribution of intercorrela- 
ae within the psychiatrists and psycholo- 
ee ee homogeneous and sym- 
ings ical, it was possible to compare the rat- 
item of the two groups: for each of the 60 
eats” the mean ratings of the 10 psycholo- 
for a correlated with the mean ratings 
am € 10 psychiatrists. The relationship was 
Get linear one, r = .96. The scatter dia- 
of th also suggested a difference in the means 

Sher two distributions. The 60 observations, 
jud ever, were not independent (the same 
statist were involved), precluding a direct 
Mean ical test of significance. Therefore, the 
a tot; r f each rater’s 60 ratings was used as 
a score, and a ż test was computed be- 
ratin the two groups of raters. The mean 
Al ey the psychiatrists was 3.67 (SD= 
‘The’, the psychologists 4.15 (SD = 26). 
for tes 4.67 is significant at the .001 tat) 
to ati indicating that psychologists ten 

an do ute greater depth to interpretations 

© psychiatrists. 


Plausini 

See Measurements 

lar anal erformed on the 
Blinc. yses were p i 
a Usibility ratings done by 10 psychologists 


r for at graduate students. The a 


he psychologists was -63 (Qt 


clusion who met the criteria for in- 
SPicuo in the sample, but whose ratings were con- 
usly deviant from his colleagues’; Was (after 


much consi 
analys Consideration and debate) dropped from the 


Stood p Although he claimed that he had unaa 
ments po tzsttuctions, it appeared that bis Ju g- 
lated Were decidedly atypical. His ratings corre- 
— “7, With his ten colleagues respectively aS aime 

— 26, 


45, — 
= 40, ae — 32, — 36, — 37, — 43, — 3% 


3 
One psychiatrist, 
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Qs = .68), and for the naive raters 68 (Qi 
= .64, Qs = .74), signifying that these plau- 
sibility ratings can similarly be done with a 
considerable amount of interrater agreement. 
The median 7’s for plausibility tend to be 
somewhat lower than the depth ratings, al- 
though the interdependence among the coeffi- 
cients does not permit a statistical test of the 
significance of the differences. It may well be 
that depth ratings can be made more “reli- 
ably” than plausibility ratings, although it is 
probably more parsimonious to assume (until 
replication or additional evidence to the con- 
trary) that these are chance differences. 
When the 60 mean ratings by the psy- 
chologists were plotted against the mean rat- 
ings of the graduate students, the Pearson 7 
was .96. Here, too, there was the suggestion 
that the less experienced graduate students 
were rating items as more implausible than 
the psychologists’ ratings: the mean rating 
for the psychologists was 3.88 (SD = .40), 
for the graduate students 4.21 (SD = .33). 
The ż of 1.9 does not quite reach the .05 level 
of significance (two-tailed test) for 18 df. 


Depth and Plausibility 


If the plausibility ratings are compared to 
the depth ratings, the relationship should in- 
dicate to what extent these two concepts are 
measuring the same or different things. Hence, 
the mean plausibility ratings of the psycholo- 
gists were plotted against the mean depth rat- 
ings by psychologists. An r of .87 was ob- 
tained, suggesting that ratings based upon 
plausibility estimates are essentially the same 
as depth ratings. Between these two groups 
of raters, where experience was equated, the 
mean ratings on the scales (3.88 for plausi- 
bility, 4.15 for depth) did not differ signifi- 

ly (t= 1.7) 
e“ the plausibility ratings by early 
graduate students were plotted against the 
depth ratings by psychiatrists, a similar re- 
lationship appeared: 7 =-8 l 

Table 2 summarizes the intercorrelations 
among the four groups of raters mentioned 
above, including also the correlation between 
graduate students plausibility ratings and 
psychologists’ depth ratings (7 = .88), and 
between psychologists’ plausibility ratings and 
psychiatrists’ depth ratings (r= 84). 
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Table 2 


Intercorrelation Matrix of Mean Ratings (V = 60) 
Among Four Groups of Raters 


Psychol- Grad. 
Psychia- Psychol- ogists students 
trists ogists plausi- _plausi- 
depth depth bility bility 
Psychiatrists 
depth — 96 84 86 
Psychologists 
depth — 87 88 
Psychologists 
plausibility — .96 
Se, 
Discussion 


Measurement of Depth 


In devising this study it seemed desirable 
to consider and attempt to control a number 
of factors which might be expected to affect 
the ratings. Three such factors appeared par- 
ticularly important, 


pth cannot, how- 


of the patient to 
the interpretations are offered. The oa 


interpretation may be for one pati 
: s a 
while quite “shallow” for ano a 


Seymour Fisher 


erate farmhand. This point is tregimi 
neglected in loose discussions on the mei 
and measurement of depth. For art 4 
Collier’s scale (2) is constructed purely o 
the basis of the type of therapi = eo 
quite independent of any specific pa t of 
Yet his scale is derived from a concep the 
“degree of uncovering” (i.e., the ie its 
interpretation “uncovers,” the greater dence 
depth) which clearly implies the ees 
of depth upon a specific personality ring” 
ture: how much depth does an Melee to 
interpretation have when a patient, P the 
the interpretation, is already aware pi 
material which the therapist is “upov en 
3. Since depth of interpretation a ware- 
conceived in relation to the degree of expec 
ness” on the patient’s part, one might tion 0 
that depth ratings will vary as a func tation 
the time in therapy when an interpre ener- 
occurred. As therapy progresses, it is 2 in- 
ally claimed that patients tend to AOT aton 
creased awareness. Hence, an interpre deep 
given late in therapy might not be eg pos- 
as if it were given very early. It is am be 
sible, however, that a late interpretati iven 
no deeper than the same interpretation o 
earlier (ie, if—relative to the en f 
the interpretation—the patient’s ee ere 
“awareness” remains unchanged). The ed in 
knowledge that an interpretation al t 
the two-hundred-fiftieth hour rather tha 
first hour is conceptually irrelevant Ee 
deep it is. There is nothing inherent ait 
variable of time per se as a sccm i wl- 
depth. The substantive point concerns a 
edge of the patient’s personuality at the 
hundred-fiftieth and first hours. Its of 
nder these three conditions, the fev lev 
the present study show that interpretive | 
els can be estimated with a high degr? au’ 
reliability by using either “depth” or “P rat 
sibility” ratings, While mean plausibility (ple 
ings may perhaps be slightly more a a 
(SD of 40 and 33 compared with -1 f be 
26), they have the distinct advantage i in- 
ing available for use with comparative yata 
experienced judges. For a series of pe er 
tions, averaging the ratings of a small me will 
of therapeutically naive graduate studen mea” 
give a fairly accurate estimate of the g 
depth rating obtained from experience 
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chologists (r= .88) or even more experi- 
enced psychiatrists (r = .86). Thus, in the 
tedious and time-consuming analysis of thera- 
peutic protocols, the need for professional 
raters might be eliminated, substituting in- 
Stead reasonably bright “technicians.” It 
should be noted, however, that less experi- 
enced judges tend to shift their ratings to- 
sg the deeper (more implausible) end of 
the scale, a finding originally observed by 
thie et al. (7). In certain circumstances 
> additional variable would have to be 
taken into account. 
are aisn in one sense, the correlations ob- 
re in this study are misleadingly high, in- 
de a as items sampling a broad range of 
eet, were used. In actual practice, raters 
cated more often be confronted with a trun- 
sample in any one case (limited by the 
nist) al scope and technique of the thera- 
would and consequently lower correlations 
relati be expected. On the other hand, the 
ra narrow distributions of interjudge 
rlii are indicative of the satisfactory 
rols ilities to be obtained when specific con- 
are placed on the measurements. 


Meaning of Depth 


m the present study, none of the judges 
whee ven any definition of the term “depth 
Mea making his ratings. Nevertheless, the 
: n rating of the psychologists correlates 

a the mean rating of the psychiatrists. 
enced i little doubt, then, that experi- 
emplo therapists of various orientations are 
ing deas some common cues in determin- 
tese ae This does not mean, however, that 
meange taPists share a common, verbalized 
Stipa for the concept. Many of the judges 
ings aneously offered comments on their rat- 
Comm he most significant aspect of a 
Men concerned the variability of the 
utili ia which the raters believed they were 

zing. Among the 20 judges who made 


7 i sg: 
offer ines a variety of definitions was 


sien to equate depth with the impact the tig 
with gee be assumed to have on the patients a 
State e lack of possibility of verification Of t 
ment by observation of the patient’s behavior. 
cabus such criteria as the directness of the vo- 
ary in the interpretation as related to deep 


253 


unconscious drives; those that were related to in- 
stinctual urges were deeper, those related to ego 
defenses more shallow. 

. ratings certainly involved at least a couple of 
dimensions besides depth—psychoanalyticness, range 
of generalization, centralization, centrality of prob- 
lem involved, etc. 

. . . depth is in itself an ambiguous concept, since 
it can be defined from several points of view, €g., 
developmental-genetic, resistance of subject to ac- 
cepting it, etc. 

I found myself giving ratings toward the “deep” 
end when: (1) interpretation was of material de- 
fended against, not of defense itself; (2) when in- 
terpretation was historical; (3) when interpretation 
tied past and present; (4) when interpretation was 
of symbolic material rather than of overt behavior 
(e.g., dreams, phantasies) . 

I sense that I tend to regard the more symbolic 
comments as “deeper.” What deeper means is a little 
obscure. “Nearer manifest content” and “assumed 
latent content” would seem to be approximates of 
“shallow” and “deep.” 


From the preceding list, it would appear 
that—on a verbal level at least—different 
therapists would have difficulty in agreeing 
among themselves as to the meaning of the 
term “depth.” Some therapists, in fact, even 
felt that they lacked consistency in their rat- 
ings (e€.8., “Pm certain if I were to do it 
a second time my reliability would be very 
low”). Yet the generally high intercorrela- 
tions among the depth raters implies that this 
is not really the case, and that there is a con- 
siderable amount of reliability in the cues 
used for rating the present sample. (One psy- 
chiatrist was kind enough to repeat his rat- 
ings after a two-day interval: test-retest r 
was .94.) 


The precise nature of these cues, of course, 


remains unknown. The data do, however, sug- 
gest that inferences in regard to depth are 
possibly based upon cues similar to the ones 
used in drawing plausibility inferences. The 
cues used by an inexperienced rater in in- 
ferring the plausibility of a statement may 
or may not be the very same cues an experi- 
enced therapist uses in estimating depth. In 
either case, however, there is the interesting 
implication that at least some of the cues be- 
lieved to be important by professional thera- 
pists may be irrelevant: specifically, that class 
of cues associated with a therapist’s theo- 
retical and professional training. Within the 
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limits of the present results, it seems that ad- 
vanced training in therapy and psychodynam- 
ics is not prerequisite for a knowledge of 
what is “deep” or “shallow”: individuals 
without such training are capable of arriving 
at essentially similar conclusions.‘ 


Depth and Plausibility 


In view of the strong relationship between 
depth and plausibility ratings, it is tempting 
to intimate that when a therapist refers to 
the depth of an interpretation, he is doing 
nothing more than making an estimate of 
how implausible his Statement would appear 
to this particular patient at this particular 
time. Clearly, the data from this limited 
study do not Provide sufficient support for 
such a contention. But even in the absence 
of adequate empirical verification, this over- 
simplified notion has a number of features 
which might be elaborated. 


1. If we equate depth with perceived plau- 
sibility, 


tions of the patient’ 


is the fact that 


concept of de 
truth-content of i 


tation disappears 
ceived truth” or p 


pth assumes 


nsion of “per- 
used. As Fest- 


Seymour Fisher 


inger (4) has observed, many opinions m 
no inherent truth value in respect to i. 
physical world. This seems particularly SPPA 
cable to the content of therapeutic interp i 
tations: whether an interpretation is dena 
“true” or not generally depends “eo aa 
training of the therapist, with an A Sa 
disputing the “truth” of a Freudian é 2 
pretation, etc. (for some encima ee 
ferring to the effects of repressed the 
and sexual impulses, one suspects ae their 
Zeitgeist also plays a role in geome aF io 
alleged truth value). Suppose a = ad 
“Your anxiety stems from the deila, ee 
spirit who lives in your stomach and e you 
you quiver inside and outside every nm epi 
become angry.” Is this interpretation ke 
Of a number of therapists who were er 
this informally, many replied that the re 
tion had no meaning, that the “interp ot 
tion” could be considered neither eg (ies 
shallow because it is patently absurd may 
obviously “untrue”).5 Nevertheless, eel 
not be absurd to a particular kind of Pa evils 
For one who believes in the reality a state- 
residing in the viscera, the therapist . (i.e 
ment may be perceived as being tru a sig- 
plausible), and conceivably could have ei 
nificant effect upon the therapeutic Fuation 
The concept of plausibility permits eva ae 
of any therapist interpretation, irrespeC 
the truth or falsity of its content. depth 
3. From the working hypothesis that ying 
and plausibility refer to the same cy inte- 
construct, it is possible to attempt, o social 
&rate recent experimental studies in sych 
Psychology with the study of the P idered 
therapeutic process, Depth can be cons 


tients 
5 But if a therapist in 1956 were to tell @ r jety 
in more simple language perhaps, that Bo 4, P 
was due to the practice of coitus interrupt! is intel 
187), would this be considered as “true”? It finitions 
esting to note that virtually all common det pini 
of an “interpretation” tacitly assume the : by H 
validity of the causal relationship expressed ing, 
therapist. Whether one talks about pers a 
“unconscious” (ie, patient being is ido alee 
the like, the frame of reference always seems < yjti- 
one in which it is hoped that the patient W: at the 
mately come to recognize the “truth” of W jcatin’- 
therapist is implicitly or explicitly comm TD G 
Perhaps it is Sufficient for the patient to @¢¢ what 
the sense of internalizing a new basic belie 
the therapist is Suggesting, 


—_[{—g_—$_ $<“ 


p 
al -W 


Plausibility and Depth of Interpretation 


as a form of “distance,” a concept that is re- 
ceiving some current attention and one which 
can be controlled and manipulated system- 
atically in a laboratory setting. By “distance” 
Is meant the discrepancy between two per- 
= opinions. That is, if P (a prestige 
ohare 7 an opinion quite similar to 
istia: 2 by S (subject), the distance is 
differe if P expresses a judgment markedly 
ti at S’s belief, the distance is large. 
equal = f-evident that, other things being 
cotet ausibility is a necessary monotonic 
more į lve of distance, larger distances being 
an inie Plausible than smaller distances. Now 
ment þ pretation is a particular type of judg- 
ceptualiy a therapist, one which can be con- 
tance AG as lying along a dimension of dis- 
is ong “deep” (implausible) interpretation 
Glen a large distance; a “shallow 
Hee €) interpretation has little distance. 
ance i statement which has zero dis- 
Says “T iat an interpretation (e.g., patient 
“You p ate my father”; therapist then says 
Unified sy your father”). Thus a new and 
Sugeeste pian definition of interpretation 1s 
the dimen one which includes in its definition 
eliminates qn of depth and at the same time 
arding the need for any assumptions re- 
oa truth value: 
judgment retation is an implicit or explicit 
emoti about the patient’s motivational 
Breater ed behavior where the distance 1s 
an zero; the magnitude of the dis- 


ance ; { 
depth, lS a measure of the interpretation’s 


Implications 


If 5 
that e 1s willing to entertain the possibility 
Person Ychotherapy is an instance of a two- 
(thera, interaction series where one individual 
tems oe attempts to modify the belief-sys- 
cial oh Mother individual (patient) by “so- 
Millis Se then some recent laboratory 
Of ther might have bearing upon the study 
Stoup Pi For example, in a two-person 
consequ has been shown that distance (and 
Variab], ently plausibility) is a significant 
’s ‘eas in determining the degree to mbien 
Senera] al judgment will conform to P's: 17 
orm the larger the distance the less S will 
m, the function being negatively ac- 
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celerated (9). From this generalization, it 
should follow that, other things being equal, 
deep interpretations should be rejected by 
the patient more frequently than shallow in- 
terpretations. It has also been found that 
when continued pressure is placed upon S 
over a series of interactions with a prestige 
figure, under certain conditions S will subse- 
quently show more conformity to judgments 
by P than ever would have been expected had 
P made these judgments early in the interac- 
tion series (6). In other words, judgments 
which would have been extremely implausible 
if given at the beginning of interaction be- 
tween P and S tend to become considerably 
more plausible after certain kinds of interac- 
tion have occurred over a period of time. 
These results may possibly offer a clue as to 
how some patients, following long-term psy- 
chotherapy, have acquired beliefs from their 
therapist (e.g. “castration fear is the basis 
of my difficulties”) which in all probability 
would have been rejected if the therapist had 
introduced these interpretations in the initial 
phases of therapy- p 

As more research findings emerge concern- 
ing effects of distance in continuous interac- 
tions, it would not be too surprising to find 
that the role played by interpretations in the 
nebulous process of psychotherapy is consid- 


erably illuminated. 


Summary and Conclusions 


Four groups of judges, three of which dif- 
fered in therapeutic experience, were asked to 
rate a series of 60 psychotherapeutic interpre- 
tations. Two groups rated for k depth ; two 
groups rated for “plausibility. High a 
group agreement was obtained on both bade 
and plausibility scales. When mean plausi- 
bility ratings were correlated with mean depth 
ratings, & sufficiently high relationship was 
found to suggest that the two scales may 
be measuring the same underlying construct. 
Plausibility ratings of therapeutically naive 
graduate students correlated .88 with depth 
ratings from experienced psychologists and, 
86 with psychiatrists’ depth ratings, imply- 
ing that advanced training in therapy and 
psychodynamics may not be prerequisite for 
a knowledge of what is “deep” or “shallo w 
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It was also noted that less experienced raters 
tend to judge interpretations as more deep 
(and implausible) than experienced thera- 
pists. The possible advantages and implica- 
tions of conceptualizing depth in terms of 
plausibility are discussed. 
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Personality Patterns of Neurotic Adults 
in Psychotherapy 


Maurice Lorr and Eli A. Rubinstein * 


The Veterans Administration and Catholic 


cone - wide agreement that present-day 
therap or evaluating outcomes of psycho- 
erally 4 are unsatisfactory. There are no gen- 
change ccepted measures of morbidity or of 
tial a few that have gained even a par- 
is nee from research workers. What 
ation th is a more objective system of evalu- 
measures 1S currently available and a set of 
sions 9 descriptive of the principal dimen- 
tidy eee anid mental illness. The 
esign eported here is one part of a program 
ed to develop criteria of mental illness 


to i r 
solate som i important di- 
ensions, e of its more Imp 


In a y, 


relations (3) the cor- 


peris analysis by the authors 
crans in etween 58 ratings of a group of 184 vet- 
Counted psychotherapy were found to be well ac- 
terns, Seis, by ten personality and symptom pat- 
Vatying see of these patterns were found to bear 
n earlier CBrees of resemblance to factors identified 
to e Studies. However, it seemed highly desir- 

ten Para Stablish more firmly the existence of these 
fied rege of which several had not been identi- 
lated re ‘ously. Clearly if these factors could be iso- 
a naoa dly in patient samples differing widely 
nce tion and with varying combinations of 
much hj Variables, they would be acceptable at a 
Bher level of confidence. 


Wi 3 
‘th this goal in mind the present study 


Was S 

ity designed to test whether ten personal- 

Coulg p °Y™Ptom patterns recently identified 
econ 


i confirmed and clarified in a S 
turn afs. The initial study was a 
en in ic and psychotic patients who ha 

Months treatment on the average for three 
tients ` When rated. In this analysis the pa- 
Who included were restricted to neurotics 
ad been in treatment for three OF four 


8toup o 


1 Fr 
D. cn the Veterans Benefits Office, Washington, 


University of America 


sessions when rated. The rating schedule used 
in the original study was also modified. The 
descriptive scales used for rating patients 
in the initial analysis were converted into 
graphic form. Scale titles were removed and 
scales were presented in a random order to 
the raters. The question was whether the same 
ten parameters would be isolated again de- 
spite these changes in composition of the 
sample and alteration in the format of the 
rating schedule. 

The study was structured around ten hy- 
pothesized constructs. The underlying pat- 
terns or syndromes included for experimental 
test were the following: (a) lack of emo- 
tional restraint vs. inhibition of emotionality, 
(b) degree of distortion of reality in thinking 
and perception, (c) anxious tension vs. re- 
laxed comfort, (d) sense of personal adequacy 
ys. its lack, (e) dependent immaturity vs. in- 
dependent immaturity, (f) conscientiousness 
vs. its lack, (8) obsessive-phobic reaction, 
(h) gastrointestinal reaction, (i) cardio- 
respiratory reaction, (j) conflict between sex 


impulses and moral standards. . 
Included also were five new scales descrip- 


tive of alcoholic addiction, defensiveness, im- 
pulsiveness ys. deliberateness, avoidance of 
attention vs. self dramatization, and accept- 
ance vs. resistance to regulation by others. 
These were constructed to further clarify 


factors already identified. 


Procedure 


The sample consisted of 215 nonpsychotic 
male World War II and Korean veterans 
with service-incurred psychiatric disabilities. 
Eleven Veterans Administration mental hy- 
giene clinics ranging, geographically, from 
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Los Angeles to Newark collaborated in the 
study.* All patients were newly accepted for 
treatment and 90 per cent had never before 
received any formal psychotherapy. The me- 
dian age was 32 and the median grade com- 
pleted was 11. 


The rating schedule (MSRPP) consisted of 61 
unlabeled, 


was about .75. 


Fifty of the 61 Scales were selected for the factor 
analysis, Of the 11 scales omi 


variables 30 to 34; 


» Variables 44 to 
- See Table 1, 


X 50 clustered Correlation Matrix, 10 


y the multi- 


were 

2 The continued cooperation of the 
5 : RE respective clini 
chiefs, chief clinical psychologists, and eee 
vestigators from the Veterans a 


hygiene clinics Brooklyn, i 
Denver, Detroit, Los Angeles, Newark, Pine Saees 
St. Paul, San Francisco, and i 


is. Bervice, +Libr 
' remitting, jn 
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i fac- 
required to locate a plane. The oblique rotated 
tor matrix V is given in Table 2.3 


The First-Order Factors 


Only those variables whose corelat g 
with a factor are .30 or higher are pen a 
the interpretations of the first-order fa a 

Factor A defines a clear-cut ee pi 
rameter of emotional responsiveness ee 
with the A previously reported. A Paine 
scoring high on 4 is relatively unres ares 
in his behavior, moody, overreaciiye “ma 
ally, inclined to dramatize himself, me In 
and overt in his expressions of bale 
addition he is likely to be cheerful in eat 
and enthusiastic in his interests. A ss a 
ing patient is relatively inhibited BE to 
strained in his emotional behavior, una only 
express anger, hate, or other feelings at 
and inclined to avoid drawing atten So 
himself. Clinicians are likely to recogni prac- 
extremes of this pattern. It is sommo oa 
tice to categorize some patients as T an 
trolled and unresponsive emotiona Zi 
others as lacking in restraint and con a pr 

Factor B appears to be measuring iciou! 
rameter descriptive of a hostile, nea 
rebelliousness against adults in aoe aA 
the maladjusted end the patient is on rity 
suspicious of others, resentful of au others 
defensive in attitude, inclined to blame ay P 
for his difficulties, unlikely to give ae by 
conflicts, and is resistive to oem in 
others. In addition he is markedly lac tor B 
concern for the welfare of others. es re- 
resembles the B of the earlier study vi rela- 
Spect to maladjustment in interpersona y > 
tions but it Jacks the gross distortion 0 initia! 
ing and Perception of the latter. In een 
Study, reality distortion, No. 14, and i In the 
reference, No, 18 correlated with B. 


the 


di 

en , 

8 The following additional tables have Pai yter 
osited with the American Documentations orrela, 
Table A, Orthogonal Factor Matrix F 0 Tran 


tions of 50 Scales with Each Factor; Table Pr oe? 
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Table 1 
Brief Descriptions of Both Ends of the 50 Scale Variables Factored 


expresses hostility overtly. 
emotional over-response. . 
frequent mood changes. 
highly impulsive. ..... 
dramatizes self... ... 


bears little hostility......---+- 
perceives world as friendly 
acceptant of authority. . . 
rarely defensive. .... 
open and trusting..... 
accepting of regulation . 
no distortions of reality. . 
no insistent thoughts. . .- - - 
attentive to outside matters. . 
no morbid fears......-+--+ 
no unjustified suspicion . 
POAXE cia ciess siestieversine 
rare sleep difficulty... . 
rarely irritable... . 
re 
untroubled. .......-++++ 
alcohol not a problem. .. - - 
rarely gives way to others. - 
unaffected by approval need. 
seldom feels inadequate. . - - - 
strong belief in self... - 
untroubled by guilt. . . - 
neglects responsibility. . 
dependent on others. . - 
weak interests oo 
low achievement motivation. . 
low standards......-+++++ 
weak impulse control. 
careless with tasks.....+-+ 
little concern for orderliness. . 
no concern for anyone. ..--> 
never considers tomorrow 
no headache complaints. - 
Cnergetic.......-00ee%+ 
no gastric symptoms. ------ 

No intestinal or bowel symptoms. 
no body concern....-++++*°°" 
No respiratory symptoms. - - - 
no cardiovascular symptoms. - + 
NO sex conflict......-++°° . 
no compulsive acts. ... s-t 
No concern over homosexual ten 
No concern over masturbation 


OOIAMNPWNHE 


unrestrained feeling. .....--++--++++85077 


dencies. - - - 


aagana restrained feeling 
. conceals hostility 
. emotional under-response 
no mood changes 
rean highly deliberate 
.. shrinks from attention 
... blames others for difficulties 
.. bears much hostility 
... perceives world as hostile 
... resentful of authority 
.. usually defensive 
... usually suspicious 
_.. resistive to regulation 
_ marked distortions of reality 
. frequent recurring thoughts 
. self preoccupied 
. disrupted by morbid fears 
. has ideas of reference 
. tense 
. frequent sleep difficulty 
. frequently irritable 
.. depressed 
. disrupted by anxiety 
- alcohol disrupting behavior 
| usually gives way to others 
_., much affected by approval need 
_ usually feels inadequate 
_ weak belief in self 
_. much troubled by guilt 
` over-accepting of responsibility 
_. wholly self reliant 
_ strong, active interests 7 
.. high achievement motivation 
_. high standards 
_ strong impulse control 
i painstaking with tasks , 
. strong concern for orderliness 
_ strong concern for others 
.. much consideration of the future 
` disturbing headaches 
_. tired and worn out 
_ severe gastric symptoms 
.. severe intestinal or bowel symptoms 
. extreme body concern 
_ severe respiratory symptoms 
severe cardiovascular symptoms 
_ disturbed by sex conflict 
.. disturbed by compulsive acts 
i .. concern over homosexual tendencies 
i guilt over masturbation 


Pre: 


Seni 3 
Princi t study these two variables have their 


are pi 


Pal projections ifferences. 
on G. These differe 
wit “oF patien 


ssibly due to the absericé 


Present sample. | 
€ third Factor C appears to jperidentical. - 
Aces No 


t 


with the C of the earlier study except for the 


es_prssence-of~a-depressive element. A manifest 


e in character, appears to 


wypo Re 


>o a RE nl ier the factor. The maladjusted end of 
zis i MN j the ‘factor. 
i p | ae symp} gayi AA - 1 Big ca by signs of manifest tension, an 


. apprehensiveness not called for by circum- 
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Table 2 


Rotated Oblique Factor Matrix V 
(Decimal Points are omitted.) 


Factors 
Scale 
No. Sf © o a r @ H x I 
1 69 06 04 07 06 02 02 13 0 0% 
2 45 33 08 34 19 -25 00 06 il =08 
3 62 -o 02 o4 11 07 03 01 12 o 
4 39 -08 -02 o% =05 05 =03 05 -06 =i 
5 26 ; 
e re a a a e 
= = = 5 - = A 
7 -17 47 21 49 re a F 02 00 “a 
7 1 12 -17 2 03 02 00 1 
8 -04 70 07 = 03 o5 19 03 —05 —09 9 
05 51 15 33 02 00 01 13 a 
10 -01 6 —02 08 16 —o4 00 08 11 g 
11 —02 53—01 os 
1 02 83 13 09 16 ~18 06 04 2 
12 5 20 o1 %6 01 18 i =i = 
7 z: 5 04 = _og 133 -17 _2 03 —01 o? 
15 02 03 E o ~O pi 2 me o ol 
16 10 19 E o o a T a a 
5 e- ae 90-15 _¢ 34 01 or 0 
18 07 2 05 ae 4 a a of 06 os 
i B =05 = 07 41 04 =0 = 
20 ot E: A u 2 o a Z 2 15 
21 -35 a 35 T n 05 06 a =U 16 
A 2 3 D -H 1 o6 -03 ġ ùi ; 
Be BS n 3 =07 -23 27 19 o2 -19 -8 
24 E a 18 05 07 12 —02 25 = 
S Do a z =08 -02 _95 09 —04 09 ; 
a -23 <i, 7% 4&2 95 06 = ~-12 05 09 
27 3 w WS 35 16 22 =f 04 23 op 
28 o Io A 65 o0 02 01 01 00 o 
29 D u © ši 39 05 o 21 V =e 
30 -2 i S 21 03 16 -07 —02 02 z 
31 05 06 11 E s a 8 = Do i 
32 Je = i ee a e a g a 
33 =05 -o2 Lo 2% 6 -u -o8 12 —19 D 
34 02 ot o “2 72 06 ot 05 00 o 
35 26 -2 43 21 70 03 o  —o5 -03 -03 
36 08 Lo 2 13 25 16 06 03 06 0 
37 a= | m= a a 8 “8 oe . =e 
38 —0 -48 o OL -o 64 02 05 or =o 
39 19 _¢9 23 v 27 i3 =0 00 06 oz 
40 13. 06 “3 3 i = 02 a6 
aa a 8 08 = 05 4 
19 00 dl =09 -08 17 17 24 y 
42 -06 -3 4 © -39 11 15 29 E =n 
F 3 L 5 
o o “ot % 05 =o er d l 
Fi ~02 6 
e+ o T? 1S -08 06 e ooo 0 
45 =10 -0 i o TB æ o 55 eM 
46 03 02 Fs a %6 93 02 -0 56 i 
47 10 12 o o  —04 0 —02 11 as =O 
48 T02 o5 2o IS -o o = 2 5i 
o I 20 03 03 
49 06 12 T z 
49 Io au Se 04 23 03 —02 38 
=H ~97 00 ne 02 08 08  —03 15 
07 -o3 o2 04 06 a 
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stances, irritability, indications of a’ depres- 
e mood, and difficulties with sleep. In clini- 
cal practice Factor C would probably be re- 


- garded as an anxiety reaction. 


The fourth Factor D is descriptive of the 


Sense of personal adequacy in the patient. At 


He Pigladiusted end of the scale the patient 
oe tendency to feel inadequate, is 
is Kimed a belief in himself and his powers, 
conflicts, to give way and defer to others in 
ior by » and is much affected in his behav- 
approval na to secure and maintain their 
cant proj xcept for the absence of signifi- 
is projection from guilt feelings, No. 36, 
earlier ey as the Factor D isolated in the 
r study, 
towed bipolar factor descriptive of drive 
Cita Cee goals. At one end of the 
or lon re is the patient whose motivation 
ceptanes erm goals such as achievement, ac- 
Whose sta recognition, or power is low, and 
in areas ra adequacy of performance, 
is int e considers important, are also low. 
erests are weak, and his energy is low 
e is lacking in belief in himself. He 
Clineq hy to consider tomorrow, and is in- 
and dire ee on others for the initiation 
of y ion of his activities. The opposite 
Whose a continuum describes the individual 
erm ti toe are much determined by long- 
ergy is 7 His interests are strong, his en- 
confident 8b, and he is inclined to be self- 
Corres and self-reliant. In the initial study 
turity ee Factor Æ of independent ma- 
elements» identified. This factor contained 
SPonsible or what might be described as re- 
OF Persist, maturity and goal-directed control 
irection ence, In the present study the goal- 
nent ¢ and independence are more promi- 
adult an tendencies toward acceptance of 
_Ponsibility, 
by a ipolar Factor F is defined at one end 
9 wE concern for system, orderliness, 
b » ne in activities and surroundings, and 
Of tag Careful and painstaking performance 
liberg A undertaken. An inclination to be de- 
tendency te reflective prior to action and r 
esponsibilit accept more than one’s share © 
€ristic ar a and obligation is also charac- 
€rizeq 7. The opposite end of F is charac- 
Mani Y a careless indifference to the per- 
ce of tasks, a lack of concern about 


Seems 


for 
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adherence to accustomed patterns, impulsive- 
ness and a tendency to avoid or neglect re- 
sponsibilities. Patients scoring high on the 
conscientious pole of F correspond closely to 
the compulsive personality delineated in the 
American Psychiatric Association’s manual of 
mental disorders (1). Such patients are said 
to be characterized by chronic, excessive, OY 
obsessive concern with adherence to stand- 
ards of conscience or conformity. A character 
trait of conscientiousness vs. careless indif- 
ference appears to be represented in F. Es- 
sentially the same factor was isolated in the 
initial study. 

In the initial study it was stated that Fac- 
tor G appears to be defining an obsessive- 
compulsive-phobic reaction. However, it was 
felt that this inference required cross check- 
ing. In the present study the patient scoring 
high on G tends to be preoccupied with in- 
sistent, recurring, useless thoughts, tends to 
distort reality in his perception and thinking, 
is disturbed by morbid fears, and is inclined 
to believe on the basis of slight evidence that 
people talk about or refer to him. As might 
be expected he is also described as much pre- 
occupied with himself. The hypothesis of an 
obsessive-compulsive reaction is plausible but 
the ideas of reference seem out of place. An 
alternative hypothesis is that G represents 
one aspect of an incipient or latent schizo- 
phrenic tendency. Obvious psychotics exhibit- 
ing delusions, hallucinations, and grosser forms 
of reality distortion and falsification were not 
included in the present study. However, no 
rigorous effort was made to exclude patients 
who might show indications of schizophrenic 
tendencies, since the data were collected for 
another purpose. The prominence of distor- 
tions of thinking and perception and the ex- 
tent of disruption of normal activities sug- 
gest that this parameter represents a more 
profound disturbance than an obsessive- 
phobic reaction. . 

The scales defining Factor H describe a 
gastrointestinal reaction. The high-scoring 
patient is likely to present symptoms of 
stomach, intestinal, and bowel disorders, and 
accordingly is likely to be much preoccupied 
with his health and the functioning of his 
bodily organs. Except for the absence of 
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headaches, Factor H is identical with the 

corresponding factor Previously identified, 
Factor J is defined only by the presence of 

symptoms of respiratory disturbance (asthma, 


ally scaled, Factor 7 would break up into sey- 
eral parameters, 


The last Factor J is characterized by con- 


Odically in Overt repetitive acts, 


The pattern Suggests a type 

disorganization and conflict that 

ego defenses crumble, 
Factor BB js inde 

resents almost mh a eae 

the latter. BB i 

primary factors BE 


and F., Ho tili 
sentment of authorit ‘ meee re- 


» Suspicion ang defen- 
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n E Table 3 


Correlations of the 50 Scales on. the 
Second-Order Factors 


(decimal points are omitted) 


Sea ee 


Factors Taero 
Scale Scale —— 
No AA BB No. AA BB 
1 —04 44 26 E E 
2 14 —09 27 2 
3 -14 23 28 2 “10 
4 -11 12 29 A 32 
5 15 29 30 =% 30 
6 10 30 ao à = 
7 —36 33 32 =o 35 
8 05 6 33 ne: 
9 2 37 34 ey 
10 ~07 49 35 a 51 
11 —=15 53 36 00 45 
12 03 35 37 a ts 
13 3195 38 n 
14 47 02 39 _— il 
15 52 02 40 -2 T 
16 23 o 41 ode 
17 9 o 42 o o 
18 29 4g 43 o « 
19 37 —07 44 ae 
20 28 —10 45 T ee 
21 09° o 46 “oe 
22 19 44 47 1 g 
23 50 07 48 7 


ʻe for 
siveness are joined with a strong drive E 
long-term goals and a conforming conscie re- 
Oushess. Compared to AA, this pattern pe 
Sents a tight defensive system with extroP 
tive elements, 


Discussion 


o 
In terms of our initial aim to find aa 
measures more descriptive of the p ie 
lmensions of personality and mental } erti- 
than currently available, there is one P pat 
nent question that might be asked. To ac’ 
extent do these factors fit into currently © 
cepted personality theory? It would e ie 
easy, perhaps deceptively too easy, ro 5 an 
cile these factors, in terms of both origi peo- 
dynamics, with a number of different call 
retical frameworks, The difficulty is not 1% p- 
In linking these factors, as parameters Of r 
sonality functioning, with one or anothe ing 
© current theories but rather in choo® f 
rom among an embarrassing number 


ri 
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equally plausible constructions. This’ is per- 
haps the same problem the clinician has when 
potted with his test data and before he 
A his explanation of the dynamics of 
E Alternate hypotheses are readily 
if R s and there is little doubt, especially 
mate me about “basic” dynamics, his ulti- 
oi his Oice depends as much, if not more, 
goo ts own theoretical persuasion as on the 
ever a of fit of data to hypothesis. How- 
Was ‘tan the present study, primary interest 
rml cused on establishing the factors more 
Rath, a i an independent second sample. 
data it an speculate with little supporting 
other a preferable to leave for an- 
or more pA the experimental testing of one 
to explai Nypotheses that might be proposed 
he in the parameters identified. 
further Problem of theoretical formulation is 
tors cane Dlicated by the fact that the fac- 
Seems ent be considered in isolation. It 
fgura ee, likely that they operate a 
0 moie individual. Thus, a higli m 
1s Commonl, or long-term goals (Factor 
It is not Y regarded as a positive trait. But 
With Site clearly positive if it is associated 
raint of emotional expression (Fac- 
and 43 hostile rebelliousness (Factor B), 
Lino. e conscientiousness (Factor 
Most ar complex interactions can be noted 
tion o of the other factors. The organiza- 
Sonality Pia parameters in the various per- 
each NLE must be considered, although 
Popula 8 relatively independent in the 
ation as a whole. 


Not . i 
Cern; her Problem that merits discussion con- 


: i . . 
is se relation of the factors identified in 
for a ePulation to those likely to be obtained 
Smptig oa group of adults. It is our pre- 
the <0" that most neurotic behavior is on 


sa : D 
Me continuum but is an extreme in 
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either direction from “normal” behavior. For 
example, an excess of restraint in expression 
of feeling and emotion and the lack of ap- 
propriate control of emotional expression rep- 
resent behavior deviations. Both are extremes 
of a trait of emotional responsiveness. If this 
assumption is valid, and there is much to 
support it, then the ten personality parame- 
ters represented by our factors are also de- 
scriptive of normal individuals. 


Summary 


This study sought to confirm and clarify 
ten personality and symptom patterns previ- 
ously isolated. A sample of 215 male World 
War II and Korean War veterans were rated 
by their therapists on 61 scales descriptive of 
patient behavior, symptoms, and certain in- 
ferred needs and attitudes. Seven of the fac- 
tors hypothesized were fully confirmed while 
three factors were regarded as related to the 
original factors only in part. An analysis of 
the correlations between the primary factors 
resulted in the identification of two inter- 
pretable second-order factors. 
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Social Values and Psychotherapy’ 


Richard Jessor 
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While problems of Professional ethics and 
of technique in Psychotherapy have received 
much attention from clinical Psychologists, 
almost no Consideration has been given to 
value problems involved in carrying on treat- 
ment. The main points to be developed in this 
Paper are that value judgments or positions 
are inescapable in Psychotherapeutic prac- 
tice; that such judgments to date have been 
largely implicit and unrecognized; that they 
are based upon a relatively narrow conception 
of adjusted or healthy behavior; and that a 


Major goal of Psychotherapy should involve 
social change. 


Perhaps the first 


Paper was read at the 
San Francisco, 


at 

bility for intervention. It simply gro a 
the therapist’s role may vary widely ethe 
very active to a very passive one. No the 
less, at every point on this dimensión, ST 
same basic value position must ag pa- 
taken, namely, that some change in eqneutic 
tient is to be facilitated, i.e., that therapi e- 
interference of some sort is necessary ne o 
sirable. Once this is done, the questio e— 
how best to achieve such behavior por e- 
whether by active or passive therapy 
comes an empirical one. tng 600 

A more difficult problem involving , ther- 
values is the question of what irago o! 
apy should take. In medicine the ToT leat- 
health is a biological one and relatively Do 
cut. The physician is rarely troubled i ness 
the direction treatment for physical $ £ 
should take. In psychology, howeve "larg 
norm of health or adjustment is to "erally 
extent relative and variable. It is Be iici y 
undefined or else defined only imp per 
Within various theoretical approaches 1° w 
sonality. The therapist, in every case ction 
ever, makes a choice of therapeutic a 
either explicitly or, most often, impli ulat 
Working within the framework of apai whi 
theory. It is the nature of these choices cho 
constitutes a serious value problem in PS 
therapy. rly all 

Discussions of psychotherapy in ne £ 
recent texts refer to two general directi jnt" 
goals of treatment. The first of these 5S actio” 
personal and usually refers to the re 


tensio™ 
or elimination of conflict or inner cept 


jal 


kar . con 
or some such subjectively-oriented he soci? 
Little or no concern is shown for t vio" 


origins, implications, or context of beba ex 
Perhaps the best example of this v: wih at 
Pressed by Carl Rogers (9). He insi e tbe 
the therapist must be willing to 8V 
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client full freedom as to outcomes, including 
the choice of antisocial or immoral goals, re- 
gression, and even death. While Rogers as- 
Sumes that such complete freedom will in- 
evitably lead in a positive direction, it is ap- 
Parent that such an extremely intra-individual 
Position as to the direction of therapy over- 
looks the fact that adjustment is in part so- 
Cially defined and certain choices are simply 
not open to the client. 
his position is usually tempered by refer- 
ence to the second major goal of treatment— 
Cameron (2) has called the agreement 
oth ehavior with cultural expectations; what 
ers have referred to as social conformity. 
ere are many difficulties in accepting this 
ta Bie Society is not an undifferentiated 
must ey neither is it static. The question 
arin asked, to what groups of society is 
o oe to conform, to which aspects 
tion eee society? In an earlier publica- 
Wrote: Ogers recognized these problems. He 
stance There is no doubt that in some in- 
as po, cial work and even clinical work 
fiteee used as a means of blocking social 
is alive” Unless the worker with individuals 
trends e to the significant movements and 
in our present-day culture, he may 


cares 
asily be seduced into upholding some fixed 


Notion of i ; 

tl ce ; » (8 
P. 355), he socio-economic situation” (8, 
det therapists are middle-class individu- 


e studies of Robert Havighurst (6), 
Ugust Hollingshead (7) offer clear-cut 
Ce of the influence of the values and 
goals of middle-class teachers (their 
Sis on neatness, manners, and polite- 
on their teaching practices and rela- 
with students. Tt is not unlikely that 
terestin e is true in psychotherapy. Some ìn- 
Tecent] & related evidence on this point has 
clinic a been published. At one outpatient 
tween See relationship was found be- 
din gpl oe class and the de- 
Schaffer the intake conference. In a study by 
€reas and Myers (10) it was found that 
Professi 64.7 per cent of patients from the 
Stonal and executive class were assigned 
residents 2, to senior psychiatric staff and 
and only only 2.4 per cent of the lowest class 
Dny 33.4 per cent of the next lowest class 


Tec l 
“ved such high-level therapists. A patient 


and A; 
eviden 
Social 
empha: 
ness) 
tions 
e s 
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of bottom-class status has between five and 
seven times the likelihood of being not rec- 
ommended for therapy as does the patient 
from one of the top classes. The authors of 
this study mention, among other reasons for 
their findings, implicit evaluations by thera- 
pists as to what sort of patient is really more 
worth while. Such evaluations need to be 
made explicit in order to determine whether 
they reflect mere ethnocentric bias or some 
broad social orientation. 

Furst (5) has stressed the implicit values 
regarding social conformity contained in psy- 
choanalytic theory. He cites, for example, 
the interpretation frequently given neurotic 
women that their difficulties with men stem 
from “penis envy,” and suggests that such 
interpretations tend to exonerate society for 
the historically inferior position of women. 

Consideration of the social-value implica- 
tions and shortcomings of the two generally 
accepted goals suggests the need to include 
a third major goal in psychotherapy—what, 
for want of a better term, may be called so- 
cial contributiveness. This goal, too, repre- 
sents a particular value orientation and is not 
without difficulties, e.g., how to get agree- 
ment on what constitutes socially contribu- 
tive behavior. Nevertheless, its components 
tend to balance the subjective and static ori- 
entations of the other two concerning adjust- 
ment. a? 

Two aspects of social contributiveness may 
be mentioned. One involves the notion ex- 
pressed by Cantril (3) and L. K. Frank (4) 
that much personal conflict is due to objec- 
tive conflicts, contradictions, and shortcom- 
ings in the socioeconomic organization in 
which the patient lives. Therapy then ought 
to influence the patient to work toward the 
elimination of objective social conflicts or to- 
ward cultural reorganization in order to es- 
cape his own personal conflicts. The other 
aspect of social contributiveness stresses the 
possible importance, for stability of person- 
ality, of a broad social philosophy. This es- 
sentially is Adler’s (1) emphasis on the im- 
portance in therapy of developing what he 
called social feeling or cooperative work for 
the benefit of others. More recently Weiss- 
kopf-Joelson (11) has made a similar point. 
She feels a consistent Weltanschauung to be 
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important for adjustment and notes its ab- 
sence in modern Western culture. The con- 
temporary stress on flexibility and tolerance 
of ambiguity as symptoms of good adjust- 
ment suggests to her “a subterfuge of an un- 
stable culture which has little to give but 
ambiguity” (11, p. 604). 

To summarize, it is suggested that psycho- 
therapists direct part of their efforts toward 
increasing the social contributiveness of pa- 
tients in two ways:—(a) by helping them 
develop broader social feelings, and (b) by 
encouraging active participation in the proc- 
ess of constructively changing their social en- 
vironments. Teaching the nature and impor- 
tance of social contributiveness makes therapy 
coterminous with education as a whole. 

The burden of this Position, of course, rests 
upon the determination of what is socially 
contributive behavior, a difficult but not in- 
superable problem. In many Cases, e.g., where 
social discrimination or chauvinism js in- 
volved in the disturbance, the answer is ob- 
viously contained in explicit values which are 


part of the general democratic tradition. For 
the future, however 


Richard Jessor 


SPSSI, might well undertake a broad sti 
of the issue of socially contributive belang ; 
The study of values need not be impet aa 
to empirical research. For one thing, a 
can get agreement on distant or more ee 
values or goals, then the relationship ee, 
immediate or specific values to those dis 
ones should be empirically determinable. 
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giao study utilizing 20 subjects 
any Fig atten that interaction patterns for 
ardized ividual during a partially stand- 
high Te hme interview had markedly 
Viewers id coefficients across two inter- 
Stability of addition to demonstrating this 
ects) Whe patient interaction patterns (ef- 
avior) fee the stimulus (interviewer’s be- 
Sions, it a controlled along certain dimen- 
Stable Me s shown that these same highly 
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Viewer’s med planned changes in the inter- 
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_ The mi 
tion el of measurement used was the interac- 
Ch 2) eee graph, an instrument devised by Chapple 
interactions bene certain temporal aspects of the 
More com, etween an interviewee and interviewer. 
and the m, Tiete description of the variables studied 
in our et od of observation used will be found 
of the leure report (5), while a detailed review 
teraction ure, a history of the development of the 
It will be _ctronogreph, and the theory underlying 
T riefly a elsewhere (4). 
ain lan standardized interview involves cer- 
each o five for the interviewer to follow during 
Hp oe subperiods of the interview; 
" ing, cad 5, consisting of free give-and-take 
: eae Periods 2 (silence) and 4 (inter- 
i Tough the ving stress phases of the interview. 
Ese Rue part interviewer's varied behavior during 
Periods, the standardized interview presents 
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to an interviewee a sequence of different behaviorial 
situations designed to elicit his characteristic inter- 
action patterns in what can be thought of as vary- 
ing miniature interpersonal situations. It should be 
noted that the stress of Periods 2 and 4 is provided 
by the overt behavior (“not responding” and “inter- 
rupting,” respectively) of the interviewer, and not 
by the “content” of what he says to the interviewee 
The durations of Periods 1, 3, and 5 are fixed (10, 
5, and 5 minutes, respectively) ; whereas the dura 
tions of Periods 2 and 4 are variable (12 failures to 
respond or 15 minutes, whichever is shorter, and 12 
jnterruptions or 15 minutes, whichever is shorter, re- 


spectively) - 

Detailed definitions of the interaction vari- 
ables investigated in this and the previous 
study can be found in our earlier reports (4, 


5). Briefly they are: (a) A’s Units, the fre- 


quency of the patient’s actions; (b) Action, 
the average duration of A’s actions; (c) 
Silence, the average duration of A’s silences; 


(d) Tempo, the average duration of each ac- 


tion plus its following inaction as 4 single 
measure; (e) Activity, the average duration 
of each action minus its following inaction as 
a single measure; (f) As Adjustment, the 
average duration during which A “inter- 
rupted” B minus the duration during which 
A “failed to respond to” B; (g) B’s Adjust- 
uration of the other (usu- 


ment, the average d 
ally the interviewer) person’s adjustment; (4) 
which 


Initiative, the relative frequency with 
A initiated to B following a double silence 
as in Period 2; (i) Dominance, the eolative 
frequency with which A dominates B in a 
double action (interruption), as in Period 4; 
(j) A’s Synchronization, the frequency with 
which A failed to synchronize with B either 
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ili ond to B or by interrupting 
y PD Synchronization, the frequency 
of the other (usually the interviewer) 
son’s failure to synchronize with A; and ( n 
B’s Units, the frequency of the interviewer’s 
niece ity reliabilities (stability coefficients) 
obtained for these variables in the previous 
study were unusually high for complex psy- 
chological variables such as one finds in the 
interview, it was decided to attempt to cross- 
validate the findings. The present study is an 
exact replication of the earlier one ; (5). 
Twenty additional outpatient Ss were inter- 


dently and in counter- 


a young internist, t 
chiatrist) . 


t series of 29 patients, 
study there Were 11 men 


Present sex distribution 
omen, 


Results 
As discussed above, 20 
standardized interview are fixe 
ing upon the subject’ 


mplete 
contains ay 
h of the 20 
from the origi 


e 
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TE : varia- 
showing that despite individual gr | 
tion (shown equally with the z approxi- 
the interview lasts, on soho: of the fact 
mately 32 minutes. This is in spi aa inter- 
that in the original series epee present 
view lasted 50 minutes, while z d only 41 
series the longest interview n ble 1 also 
minutes. The results shown a -effect per 
duplicate the finding of no doc o wenden! 
se; and show again that there is lengths of 
of an order effect since n identical. 
all first and all second interviews a a signifi- 
Interestingly, the earlier finding a. Silence 
cant (p of .05) order effect for not cross 
variable with the two doctors n ce F was 
validated. The value of the mig indicating 
now found to be an insignificant . omparable 
that both doctors were eliciting tues for the 
mean silence values (as well as bie Fhe across 
other variables) from the 20 a origina 
the total interview. Also, as in "ae o 
study, on replication the mean and Perio 
Period 2 (7.63 and 8.28 minutes) Fe almost 
4 (2.47 and 2.35 minutes) po the tw0 
identical for the 20 patients Bia 752) for 
interviewers. The value of rho a patients 
length of Period 2 for each of the nt at 
with the two doctors was ms dee oe range 
‘01 level, whereas the extremely u of rho 
for Period 4 made the obtained va m 
008) of little practical use. ients; 

i Table 2 presents, for the 20 P (for 
Means, standard deviations, and f teraction 
the total interview) of nine of the ee for 
chronograph variables. Values ke 3 i 
each doctor, with Pearson coefficie wn in n 
relation (stability coefficients) sho gon coe 
Second column from the last. Pear enthese 
ficients of correlation, shown in A is y for 
are reproduced from the origina 


-on Series 
Original Series Repiene ge 
s Ran 
Analysis Mean Range Mean o sA 
Length of all 40 interviews 32.8 25.7 to 50.3 31.5 ae to HK 
a. Length of all first interviews 32.9 26.9 to 41.4 31.3 25.6 to 404 
b. Length of all second interviews 32.8 25.7 to 503 31.6 345 to A 1 
c. Length of all first doctor’s interviews 33.5 26.9 to 50.3 30.9 5.6 tO 
d. Length of all second doctor's interviews 32.2 25.7 to 41.2 32.0 
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Table 2 


Means, Standard Deviations, Ranges, and Coefficients of Correlation Across 
Total Interview for Major I-C Variables : 


* 
by 0, Value; 
.6 s for vari: 
A Y variables 2 through 7 are given in hundredths of a 


Variable Dr. 1 Dr. 2 
i z — s f 
Mean Pts Units 68.30 76.65 926 
SD 25.98 26.69 (747)t a 
nge 39 to 132 41 to 133 
Mean Pt.’s Action* 54.65 41.75 786 
: 786 
e 36.06 23.83 C956) w 
Range 12 to 130 11 to 109 
* Mean Pts Silence 9.55 9.10 744 i 
= 3.16 2.26 (.759) l 
Range 5 to 19 6 to 15 
© Mean Pt.’s Tempo 53.65 48.55 905 ot 
v 22.33 19.61 (.908) 3 
Nange 19 to 100 19 to 100 
<M š 
Tean Hes Activity 35.00 30.35 891 o1 
= 23.35 20.28 (.930) j 
ange 4 to 87 3 to 85 
-M ; 
ean Pt.’s Adjustment —1.08 —.66 853 Ot 
= 1.43 1.29 (.802) 
Range +.50 to —5.64 +.88 to —4.95 
-M : 
ean cy Adjustment —2.24 —1.93 749 01 
ae 1.21 69 (.737) 
$ Range —.77 to —4.82 —.88 to —2.97 
" 1 a 
Mean Pts S 84 85 741 ot 
5 D ‘08 05 (.726) 
3 ange 69 to .97 .77 to 98 
M 
Seg Des Units 58.75 63.45 909 01 
a 26.16 24.94 (772) 
ange 28 to 119 32 to 115 
To convert to seconds, multiply the given value 


minute. 


tV: 
alues į 
Sin pa aa Sr n 
parentheses are reproduced from original study for comparison. 
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Nges, 
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Proxim 
View 
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and 


É. intera 
es wit 
i © Made 
a Table 


ariso ” 
ae The values of r for the replica- 
, ranging from .741 to .926, again 


a striki ia thee i : . 
iking stability in interaction varia- 


id, 


r 
2 Po to second interview for each of 
: nts. Furthermore, as can be seen 
oe ai; „standard deviations, and 
iS stability is absolute as well as 
3 i us, for example, the ranges for 
its” show that during the same 
one psd 32-minute standardized inter- 
Pi ant 39 times with Doctor 1 
t a t Dator 2, whereas a second 
kD 32 times with Doctor 1 and 133 
fe octor 2. Similar comparisons can 
r each of the other variables shown 


al study, “Action” was the 
with an 7 of .956: on 
replication this value dropped slightly to 
.786. On the other hand, “Pt.’s Units,” with 
an r of .926, was now the most stable variable. 
Despite these slight (statistically nonsignifi- 
cant) differences, however, all reliability co- 
efficients on replication again were found to 
be significant at the 01 level of confidence. 
Thus using predefined and partially stand- 
ardized interview conditions, and taking the 
total interview as the sample, patients iow 
markedly similar interaction patterns from 
one interviewer to the other, i.e., independent 
of which doctor is conducting the interview. 


In the origin 
most stable variable 


270 


Table 3 demonstrates that interaction pat- 
terns are invariant only as long as stimulus 
(interview) conditions remain the same across 
the two interviewers for the total interview. 
As any single interviewer varies his own be- 
havior within the interview—from one sub- 
period to another—there js a corresponding 
change in the means obtained by patients 
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with him for any one variable. Thus, P 
example, the average interviewee values k 
“Silence” with Doctor 1 for Periods 1 to 4 
respectively, vary from 9.15 up to 15.05 
back down to 9.40 and down still i 
5.65 and finally up again to 8.50 hundre = 
of a minute as Doctor 1’s own silence 7 
havior varies (see “rules” in earlier repo 


Table 3 


Means and Standard Deviations for Two Interviewers for Each of the Major I-C Variables 
for Each Period in Replication Series 


—. 
5 15 Temp? 
Pt.’s Units Pt.’s Action Pt.’s Silence Rates 
Period Det Dr.2 Dr.t  Dr.2 Dr.1  Dr.2 Dr. 1 2 
63.9 
WEST 19.50 22.65 68.40 54 9.05 77.90 ‘64 
SD 12.06 13.41 46.16 a 7 244 4729 3 
62.15 
E M 12.90 13.30 44.25 48.80 5.05 13.10 59.05 ot 
3a ‘784 2946 31.97 ees 2305 3 
10 
im M 9.95 11.85 87 mio | 
i 40 53.05 9.40 9.30 91. 38. 
SD 6.79 6.44 87.30 37.52 4.21 290 87.19 i 
0 
Iv M 1485 14.50 5 16 
r 11.25 i 5 16.9 40 
SD 336 239 oA, gen D pa 630 7 
10 
A Gig 1435 62.50 42.89 850 8.05 nio 315 
613 6.52 49.35 31.44 180 229 48.56 ; 
Total M 68.30 7665 48.5 
. 6.65 54.65 417 53.65 ‘6! 
an 2595 26.69 36.06 23.83 316206 233 P 
Pt’s Activity Pts Adj 15 Units 
-’s Adjust, Drs Adj , h Dr. 
= - S Adjust. Pt.’s Synchro. 
Period Dr.i Dr.2 TEE rag -1 pr? 
: rl Dro Dri D2 Dri Dr.2 De 0 
y OOO 4 e Gt 90 18.85 etn 
45.15 31.12 149 4 -—39 ag .99 1.00 A 12. 
a he i 68 25 18 03 00 Us y 
29.75 36.25 = 3. 
SD 33.29 33.86 or ~48 cims —10,50 26.26 oH 1,62 
: 37 4.96 3.63 18 12 4 0 
Ill M 78.30 43.85 ~1.56 90 iL, 
SD 87.70 37.00 3.39 i =5 -y 1.01 1.00 2 5. 
18 26 Ad 06.03 G 5 
IV M BHD 380% ~ i 5 9 
SD 548 380 1.03 Fis 138 1.28 99 1.00 era 2: 
ea i 70 56 03.04 i 35 
54.15 34.90 =y 19: 
SD 50.00 31.52 Tos pe =33 33 1.00 100 1 60 
ae 22 13 02  .00 : Py 
Total M 35.00 30.35 a ih 
SD 23.35 20.28 e Po -2 -103 84 85 ae 94.9 
$ 29 1.21 69 08 05 26. 
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Table 4 


Correlations for Two Interviewers for Each 


of the Major I-C Variables 


for Each Period in Replication Series 


Pt.’s Units Pt.’s Action Pt.’s Silence Pt.’s Tempo Pt.’s Activity 
Peri — 
od r rho r rho r rho r rho r rho 
I 
u -909 .870 711 870 618 S74 -706 870 718 792 
tr -201 .474 .828 .165 -613 -732 857 746 776 651 
Iv -788 .697 .428 .655 ASL OAL 407 -650 455 630 
y 578 430 676 617 3 9 215 270 .728 784 
823 817 662 821 555 A84 666 824 658 776 
Total l 
.926 917 786 914 744 828 905 941 891 910 
i Pt.’s Adjust. Dr.’s Adjust. Pt.’s Synchron. Dr.’s Units 
eriod E 
: r rho r rho r rho r rho 
Ir 13 733 254 525 .000 .850 -909 842 
u .051 .375 -168 808 537 591 537 594 
Iv 785 565 —129 —.023 —.027 671 .783 .700 
y .307 227 .576 591 161 546 503 395 
: 470 306 510 614 000 793 „807 -830 
otal 
853 821 749 .780 741 a7 909 .880 


Note. 
Toku 
Orr = 444, p < 105; [orr = .561, p <01. For rho 


from i 
of the sponding quickly (within one second 
to not Events last utterance) in Period 1 
2, to ahem: for 15 seconds in Period 
» to = eg within one second in Period 
and to ene the patient in Period 4, 
eriod 5 ponding within one second again in 
Octor 2 T similar pattern is evident for 
Correlated he value for F across these 5 
ES Tigges a S (3; PP: 284—296) was 14.80 
Significant 1 and 23.44 for Doctor 2, both 
“Xaminati at the .001 level of confidence. 
tit On reveals that “Action” as a pa- 
of Cb vee variable is also a function 
Particula; the interviewer is doing during a 
the intery Phase of the interview. Thus when 
Conduct; viewer (Doctor 1, for example) was 
Periods Pa a free give-and-take interview in 
duration , 3, and 5, the patients’ average 
40, ee utterance (“Action”) was 68.40, 
"Upting th 62.50, whereas while he was inter- 
age acti em in Period 4, the patients’ aver- 
on fell dramatically to a value of 


= 427, p <.05; for rho = .543, p < 01. 


11.25 hundredths of a minute. Interviewer’s 
silence in Period 2 likewise was associated 


with a slight drop in patient action to an 
average value of 44.25. A similar statistically 
significant ($ of .001 in both cases) pattern 
is evident for patients’ “Action” with Doctor 
2. It should be pointed out that we are here 
dealing with averages,® since Chapple divides 
all patient variables in a given period by the 
number of patient units in that period, thus 


idividual records of the 20 pa- 
independent of each patient’s 
o showed the drop in “Action” 
d 4 with a subsequent in- 
pattern was true for all 20 
patients with Doctor 1 as well as Doctor 2. The 
picture is less striking for increased “Silence” in 
Period 2 relative to Periods 1 and 3; with Doctor 1, 
only 15 out of the 20 showed the group pattern 
shown in Table 3. Interestingly, the same 5 patients 
(and only these) again showed this deviation from 
the group trend with Doctor 2, thereby indicating 
the “stability” of this pattern despite this deviation 


from the group average. 


3 Analysis of the in 
tients reveals that, 
own base line, all 2 
from Period 3 to Perio 
crease in Period 5. This 
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controlling for the differences in the lengths 
of the five periods, as well as controlling for 
individual differences in interaction rates 
among patients. 

The values shown in Table 3 are thus a 
replication of the earlier finding that means 
of interaction patterns of patients, while in- 
variant under identical interinterviewer con- 
ditions across the interview as a whole (Table 
2), are markedly susceptible to changes in 


l » 4S seen in Table 4,3 
Period-variable Combinations have 
significant Pearson p’. 2 
and 8 at the 05 level. 
order correlation, 
each variable in Table 4, 
yields 38 significan 


“Pt.’s Synchronization” where, due t 
ited range, four out of the fi 3 
fail to reach significance 


9 a lim- 
ve period-variables 
when + js used and, 
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in contrast, all five reach the .01 level when | 


tho is used. In some cases, then, rho nat 
better statistic for these data. We have no 
used it routinely only because, unlike 7, it is 
a terminal statistic and does not require 
computation of measures such as means a 
variances which can be used in further analy 
ses. The values of rho for the total — 
are given at the bottom of Table 4 and ae 
can be compared with the values of 7 pe 
from Table 2 for the same variables. E 
ever, whether 7 or rho is used, it is ige 
to remember that the correlations shown of 
Table 4 are based on only a small ed 
the total interview sample (e.g., Perio te 
Correlation values represent only 5 minu is 
of the total 32-minute interview). Oni 
therefore all the more struck by the sini a 
or stability of interaction patterns exhi 
by the 20 patients with the 2 interviewen a - 
Finally Table 5 shows the stability an 
ficients for the “Initiative” (Period 2) both 
“Dominance” (Period 4) variables a are 
the original and present studies. i = 3 
values for r; values for rho are .556 an ively, 
for Initiative and Dominance, repe on 
both significant at the .01 level. aang eir 
cross validation there is a reversal in con- 
relative magnitudes, both variables show that 
siderable stability. When one zenen fe 
Period 2 (silence stress) lasted only 4 (ir 
minutes on the average, and Period snutes: 
terruption stress) only slightly over 2 " nb 
these stability coefficients are quite sii A 
The degree of invariance of a single bmis” 
viduaľ’s “initiative” or “ascendance-sU ea 
sion” patterns could be investigated in A he 
detail by extending in a separate stu A 
lengths of these two periods to perhal pat 
minutes each. It is reasonable to assu™¢ be 
a larger sample of these behaviors wencien 
associated with a higher stability coe noted 
Before leaving Table 5, it should pe the 
again that, on the average, patients ta jate 
initiative more than they have to be i? 


S 


ay 10 

*Our earlier suggestion that the reliabili toe 
Dominance, which was lower than Initiative Pp 

first study, might be a function of the “faste TA 

of Period 4 relative to Period 2 is not borne thes? 


. H 0 
this reversal in the relative magnitudes of 7 
2 variables, 


a 
gg _ Fe 5 


a easel 
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Table 5 


M iati š 
eans, Standard Deviations, Ranges, and Coefficients of Correlation for Two Interviewers for Initiative 
(Period II) and Dominance (Period IV) in Original and Replication Series 


Original Series 


Replication Series 


A Variable Dr. 1 Dr. 2 r Dr. 1 Dr. 2 t 
- Mean Initiative -15 77 .805** 72 73 552* 
= 18 19 18 a ae 

ange AT to.94 .23 to 1.00 25 to .92 .42 to 92 

wy f ` 

Mean Domiüänce =32 —.42 470* —.36 —43 607** 
z 31 “30 31 26 f 

ange —.71 to +.83 —.92to+.29 —1.00 to +.13 —.92 to +.00 


* Signi 
ignificant a A m 
k H at the .05 level 
i evel of probability. 
gnificant at the .01 level of probability. 


to 
Aada +.72 and + .73) under condi- 
ominate ( ence, and submit more than they 
interry — .36 and — .43) under conditions 
eViations tenn, The fairly large standard 
at thes or each of these variables indicate 
that indiy eang are only group trends and 
“ee sea vary considerably in these 
Sions of their interaction patterns. 


Discussion 


The + 
indica alts of this cross validation would 
Ones we h interaction patterns such as the 
Personalit: ave studied, as one dimension of 
Changes et are both modifiable by planned 
Markably A airasinteRoTewe? behavior and re- 
Other in i able from one interviewer to an- 
his nen vias conducted on the same 
actors, na E may be a function of many 
Patient on fe which may be the “set” of the 
Mterviews i. particular day he has his two 
© patient f this is true, one would expect 
be differen S interaction pattern possibly to 
in a if the two interviews were sepa- 
Sain on FS We have completed a study, 
Viewer int subjects, in which a single inter- 
Occasions erviewed the same patient on two 
Study, sia week apart. The results of this 
US with sss being analyzed, should provide 
ecide iia, ormation which will enable us to 
8taph as usefulness of the interaction chron- 
of beh vi an instrument for measuring changes 
tion st or im time (for example, as a func- 
interpolated psychotherapy, etc-)- 


However, the results of the two studies al- 
ready completed seem to indicate that the 
interaction chronograph has promise as an 
instrument for assessing changes in behavior 
during a single day (test-retest changes in 
behavior as a function of the administration 
of a drug, for example). 

Another factor which is of theoretical as 
well as practical importance is the effect of 
the content of the interview on the interaction 
patterns. We have been working on a method 
of content analysis and hope soon to be able 
to compare, for these same interviews, what 
the interviewee said with how he said it, i.e., 
“content” vs. interaction chronograph pat- 
tern. In this manner we plan to investigate 
Chapple’s hypothesis that interaction pat- 
terns are relatively independent of content. 


Summary 


The present investigation, a replication of 
an earlier one, was a study of the interaction 
patterns of 20 patients who were interviewed 
independently by two interviewers on the 
same day. The demonstrated cross validation 
of our earlier findings indicates that a single 
patient’s interaction pattern is both sus- 
ceptible to planned changes in a single inter- 
viewer’s behavior (intra-interviewer modifi- 
ability) and that this pattern is remarkably 
stable, or invariant, from one interviewer to 
another (interinterviewer stability). Research 
currently in progress is designed to investigate 
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further aspects of this time dimension of in- 
teraction patterns. 
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e 
Se ce or other visual-motor tasks where 
of the a be reproduced. The purpose 
e studies igation was to repeat and extend 

, 2, 3) of rotation reported by Shapiro 
Papers Fh Yates (4). In a recent series 

n of ey discussed the effects on rota- 
Such factors as changes in geometric 


Properti 
jects (ss of the target, blocking the sub- 


the 5 


tio 


», 

S) peripheral vision, intelligence of 
(BDRT p Block Design Rotation Test 
S’s task ), which was devised by Shapiro, the 
Signo.) tO reproduce a blue and yellow de- 


2 One inch + i 
ix i s 
Six inches quare, painted on a white card 


blocks t square, Each design requires four 


Block poet from the Wechsler Bellevue 

Ured ag = subtest. Rotation (R) is meas- 

reproduced number of degrees which the S’s 
that o th design differs in orientation from 
Summed e target design. These scores are 

; Th 

t 


Thi 
Pinin Dort concerns the phenomenon called 
i which sometimes occurs on block- 


a oe all forty cards. 
test the T was constructed especially to 
d certai ssumed relation between rotation 
designs T geometric properties of the target 
ure of poe properties arise from the na- 
of symm i ground, the figure, and the type 
card on pe involved. The ground—the white 
Sehted eith ich the design is painted—is pre- 
Fee ou ss A a square or a diamond. The 
Square or ieee is also presented either as a 
n imagin lamond. The line of symmetry is 
Mirror oa line which cuts the design into 
Possible. 2 Two kinds of symmetry are 
is ectanglar, in which the line of sym- 
vertical or horizontal, and diagonal, 


in which the line of symmetry is 45 degrees 
from vertical. In Figure la, for example, the 
target has a square ground, square figure, and 
diagonal symmetry. In Fig. 1b, it has square 
ground, diamond figure, and rectangular sym- 
metry. 

Over the 40 cards with their 10 basic de- 
signs, all possible combinations of symmetry, 
figure, and ground occur an equal number of 
times. They are presented in a balanced or- 
der developed by Joan May (2, p. 617). 

Shapiro’s findings concerning the geometric 
properties of the target can be summarized 
as follows: (a) diagonal symmetry produces 
more rotation than rectangular symmetry; 
(b) diamond figure produces more rotation 
than square figure; (c) diamond ground pro- 
duces more rotation than square ground; (d) 
the order of effect of the three properties is 
symmetry, figure, and ground; and (e) the 
effects of symmetry, figure, and ground are 
additive. 

Shapiro, and later Yates, found that brain- 
injured Ss rotated significantly more than 
control Ss. About 75 per cent correct classifi- 
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rå 
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Fig. 1. Two possible combinations of symmetry, 
figure, and ground. 
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cation can be obtained with their data when 
R is used as a predictor variable. 

With the finding that the factors of sym- 
metry, figure orientation and ground orienta- 
tion appear to have directional properties 
which affect the amount of rotation, Shapiro 
developed a theory to account for the rela- 
tionship between brain injury and rotation. 
He argued that if one could assume that the 
brain-injured Ss tended to focus on the cen- 
tral part of the target at the expense of the 
periphery, then directional properties of the 
target would presumably exert a more power- 
ful influence toward rotation than the direc- 
tional properties of the more peripheral back- 
ground. He then deduced that non-brain-in- 
jured Ss, deprived of perip 


rotate as much as brain-injured Ss and 
ý th 
they would respond to ` 


ree main problems arı 
(a) the effect of ; 
í f 

tion of figure, pk 
rotation; (b) th 
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1. Brain-injured without field reducer (BG). 
2. Brain-injured with field reducer (BF). 
3. Controls without field reducer (CG). 
4. Controls with field reducer (CF). 

5. Low-intelligence controls without field re- 
ducer (CD). 


Subjects and Procedure 


Selection of Subjects 


Forty male brain-injured patient 
lected from the Neurology and Neurosut | 
Services at Walter Reed Army Hospital. 
brain-injured sample was heterogeneous wig 


s were Se 
gery 


respect to diagnosis. There were 18 hea mi 
jury cases, 13 patients with neoplasm in 
vascular anomalies, and 9 with diffuse b 
pathology of various kinds. The SS ealt 
described as young males, in good jy in 
prior to illness, who were examined ear gen- 
recuperation from injury or surgery- ie 
eral their brain injuries were acute fold 3 
than chronic, and diffuse rather than 


, among 
Sixty male controls were obtained from pet- 


non-brain-injured medical patients. They bie ams 
erogeneous with respect to diagnosis, but “ited n 
bulatory, and not acutely ill. They had ai jon ®! 
neurological symptoms on a routine ezamina ected i 
admission. Twenty of these controls IP res 
on the basis of low intelligence. Their $ 
Aptitude Area I of the Army Classification. 2 
were at or below the thirty-second perce? ee v 
Not all Ss were able to complete all CR an ; 
enough for rotation to be measured. If 5s signs a 
able to complete at least three of the five 
One of the subsets used to test the effects ‘rom ae 
ground, and symmetry, they were dropP¢ 
Study. There were four such Ss in each ontil 
four subgroups. Sampling was continued U i 


ple t 
per group were obtained. It has not been Poss. fo 
evaluate the biasing effect of dropping thes to 20 ‘3 

The field reducer was assigned randomly čo pori 
the brain-injured group and to 20 of the es oF 
Since the effect of eliminating peripheral ing te8t pe 
dependent of the working surface) was Pe” er t 
all Ss worked on a black felt cloth spre@ 
table top. 
ean 


2 Our thanks are due Lt. Colonel Jame 
mill, Chief, Neurology Service, Walter R 
Hospital, who made the final diagnostic “ine 
each case, r 

2 Aptitude Area I is based on scores 0n V 
Subtests which have been shown by Stone 
Personal communication, 15 July 1955) to yue 
stantial correlations with Wechsler Belle ly tn 
Scale IQ. The percentile corresponds rous”™”, 
IQ of 80 to 85. 
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Table 1 


Effect of Symmetry, Figure, and Ground on Rotation 


Ground Figure Symmetry 
G Significance Significa: igni 
<P D>S* Level D> S* i Di > Ret ae 
F 
14 NS 19 
BG D 1% > 
Cr 12 NS 15 3% ig NS 
CG 10 NS 19 1% 15 5% 
ČD 9 NS 19 1% 16 1% 
15 5% 16 1% 17 1% 
Sum 
60 5% 88 1% 75 1% 


lesigns with sl s. 
mat DiS h square shapes, 
an for désigns fers to the number of 

s with rectangular symmetry. 


Prior š 
th to administration of the BDRT, all Ss in 


e first fi 
Wechsler Bell Eroups were given five subtests of the 
ese were levue Adult Intelligence Scale, Form 1. 


Vocabulary Arithmetic, Block Design, Similarities, 
Pressure, the oF Comprehension. Because of time 
Sign and Ar D group was given only Block De- 
> Arithmetic. 

“Ocedure 


The 


Shaitan eo was essentially the same as 
e, carat cards were presented one by 
with the on the table from left to right, 
Placed 12 į edge or corner nearest the S 
PT a inches from his edge of the table. 
sible Wa seated as close to his edge as pos- 
as close t was told to construct the designs 
Menter fs the edge as he could. The experi- 
ished 4 sit, OPPosite the S. When the S fin- 
and chon tee he was instructed to turn away 
Cordeq tis eyes. At this point, time was re- 
Measured the degrees of absolute rotation 
With a protractor. 


Results and Discussion 


Yy v 
lowing e kes a summary statement, the fol- 
ral but can be made. The results are in 
apiro’s o not complete agreement with 
and the y n the relationship between rotation 
fect o a a stimulus properties. The ef- 
Ocking peripheral vision in brain- 
YPothesie is not in line with Shapiro’s 
ear t ki and differences in intelligence ap- 
more important than he assumed. 


tim 
ulu ih n 
$ Properties and Rotation 


o 
me 
Property a the effect of each stimulus 
> different subsets of problems were 


ran 
than on p>” rel 
on the 20 efers to the number of Ss whose total amount of rotation was great i 
n th s a s er sth di 
a g! on the 20 designs with diamond shapes 


Ss whose total amount of rotation was greater for designs with diagonal symmetry 


compared with one another. For example, in 
measuring the effect of ground, an S’s rota- 
tion score on the 20 cards with a diamond 
ground was compared with his score on the 
20 cards with a square ground. Then the 
number of Ss in each group was determined 
for whom the first score was higher than the 
second. 

Table 1 summarizes these results and pre- 
sents also the results of sign tests. The sign 
test was used rather than the usual ¢ test be- 
cause in all groups, R was distributed non- 
normally with a large positive skew. 

Table 1 shows that the diamond figure pro- 
duces more rotation than the square figure, 
and diagonal symmetry more than rectangular 
symmetry. These results are in agreement 
with Shapiro’s. The results on diamond vs. 
square ground, however, are somewhat equivo- 
cal (out of 100 Ss, 60 show a difference in 
the expected direction, but in only the CD 
group is the difference significant). The com- 
bined results are significant, however, at the 
5 per cent level.* 

When Shapiro assessed the relative strength 
of the geometric properties of the target, he 
found that, in general, diagonal symmetry 


was associated with more rotation than dia- 

3 For complete tables of raw data, details of pro- 
cedure, and description of the sample, as well as 
for discussion of certain differences between our pro- 
cedure and Shapiro’s, the reader is referred to Walte! 
Reed Army Institute of Research Interim Re at 
(in press) entitled “An Experimental Study of Bl k 
Design Rotation.” y of Block 
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mond figure, and that diamond ground was 
least effective. Table 1 indicates that, in the 
present study, figure tended to affect the 
amount of rotation more than symmetry for 
four of the five groups. The effect of ground, 
as Shapiro reported, tended to be weakest. 
What about the interaction of symmetry, 
figure, and ground? Shapiro Teasoned that 
from the Gestalt viewpoint, incongruent com- 
binations should produce more rotation than 
congruent ones. He took the amount of rota- 
tion on trials within congruent figure-ground 
cards (ten designs with a square figure and 
square ground, plus ten designs with a dia- 
mond figure and diamond ground) and com- 
pared it with the amou 
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The present results, then, concerning Me 
relation of rotation to the Spee 
of the target designs differ from S an A 
in only two respects: (a) figure is se ü 
be more powerful than symmetry, a anil 
figure-ground incongruence produces S n 
cantly more rotation than figurera ou only 
gruence. Thus there appear to a ks i 
independent effects of symmetry, ae jer 
ground, but also a Gestalt interac 
tween figure and ground. 


The Effect of Blocking Peripheral Vision 


resent 
In line with Shapiro’s remia tl 
control group showed more rotation 


3 1). mM 
field reducer than without it (p < Oe 
disagreement with the extension 0 ee 


hypothesis, rotation by oot age 

the field reducer is significantly Że: 

Without the field reducer (p < 01)-_ ons are 
The scores on which these compans le 

based are given in the first two lines a of 10° 

3, which shows the mean and mane groups, 

tation scores (M) for each of the = o [log 

(The logarithmic function M = duce 

— 1] was used in place of R to re 

very large positive skew.) 


n ested 
(1) round A ey for incongruent o will be recalled that Shapiro SUB he 
rotat Ww Eromi designs to Produce more that the brain-injured tend to aisen ing th? 
ha Ta T the congruent (C) figure-ground periphery, If this were so, then b O itferen®® 
ged 1S tendency *ppears in each of visual periphery should make little + about 
nificant oe oe the combined results are sig- to the patient, and one would exp BE group 
wo tater i ms geet cent level. The other the same amount of rotation in the Phe pF 
Bae ‘actions do not reach a Significant as in the BG group. The fact that G sug 
sults, MY group nor in the combined re- 8toup shows less rotation than the pe 
8ests that the field reducer may P” | 
Table 2 
Interaction of Symmetry, Figure and Ground 
d 
oun 
Figure and Ground Figure and Symmetry Symmetry and Gt" 
acan 
Signifi Wa jønific™ 
Group CS T I>c En r>C* “ied 
Be A 5% 10 NS 8 N 
CF a RE 10 NS 12 NS 
CG i NS 8 NS 12 NS ‘ 
A NS 10 11 S 
cD 14 NS : NS 5 N 
Sum NS 
% 1% 45 NS 51 o 
*"T >C" refe 


ers to the num! 
on the 20 congruent designs, ber of Ss whose total amount of Totation was g 


hi 
asit 
Teater on the 20 incongruent desig! 


— , —— 
—————— 
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Table 3 
Rotation Scores (M) and Their Relation to Scores (T) on Wechsler Subtests 


Statistic BF BG CF CG cD Total 
N 
V 20 20 20 20 
M m 2 20 100 

: 131.25 165.55 144.85 115.95 5 
¥ 1,271.78 1,114.89 1,352.13 807.21 see 1 ey 
a 26.50 23.20 27.25 30.45 20.95 "95.67 
a 111.95 122.90 92.62 69.73 39.63 91.90 
ae —.56 =i S —.38 =el —.60 

T =1237 15.34 2.72 —19.79 14.10 ` 


triph en 
aly eae from distracting the brain- 
More effecti us enabling him to concentrate 
apiro’s reader on the target. In place of 
then aide byponesh, one would 
rain-j tute the notion that the periphery 
un-injured Ss provides distorted and 


confus; ; 

ing . 

of ref ng information about the visual frame 
elerence, 


Th 
€ Effect of Intelligence 


Ho 
nated free can brain-injured Ss be discrimi- 
TOtation m controls? As Table 3 shows, the 
igher oe in the BG group are much 
ference po those in the CG group. (The dif- 
: is significant beyond the 1 per cent 
off, e M score of 136 is used as a cut- 
can be T cent of the Ss in these two groups 
Uso infest a correctly. However, Table 3 
t correl €s that there is a substantial nega- 
Score tion between the M score and a 
et Block Wiere T equals the sum of Wechs- 
reported „Design and Arithmetic. Yates also 
tween n at negative correlations be- 
DEUD has ae and rotation. Since the CG 
G grou igher intelligence scores than the 
Correg, a perhaps not all of the 75 per cent 
a ea cation was due to brain injury 
dul (cp is was the reason for adding the 
Sidere group. In fact, when CD is con- 
Cutoge Patt of the control group there is no 
timinati Score that will produce usable dis- 
trols, Tyan between brain-injured and con- 
all of 7 finding raises the question whether 
rages for Satie between the rotation av- 
rely to a five groups may not be due en- 
iy on age in intelligence. To test 
oe ysis of covariance of M was 
Score w. 8 T constant. That is, each S’s 
as statistically equated for the ef- 


3 


ir 


fect of intelligence. The results showed that 
the rotation means, even when corrected for 
intelligence, differed significantly beyond the 
1 per cent level. 

In Table 3 the line labeled M — Mr gives 
the rotation means corrected for the effects 
of intelligence scores. An immediate contra- 
diction appears. The CD group has a signifi- 
cantly higher average rotation score than the 
CG group even after correction for intelli- 
gence. Since these groups were intended to 
differ only with respect to intelligence, this 
suggests that some unknown sampling bias 
toward higher rotation in the CD group may 
have existed. 

So far, then, it appears that rotation is af- 
fected somewhat by the geometric properties 
of the target card, and a great deal by the 
intellectual functioning of the S. It is diffi- 
cult to conclude from the data what the di- 
rect effect of brain injury is on rotation, since 
there appears to be an interaction of brain 
injury with the effect of eliminating periph- 
eral cues. 

Summary 

The Block Design Rotation Test was given 
to five groups (with 20 Ss in each): (a) brain- 
injured patients who wore a field reducer 
(ie. eye-mask that restricted peripheral vi- 
sion); (b) prain-injured patients without 
field reducer; (c) non-brain-injured patients 
without field reducer; (d) non-brain-injured 
patients with field reducer; and (e) dull nor- 
mal patients without field reducer. Most of 
the relationships given by Shapiro and Yates 
were confirmed: 


1. A diagonal line of symmetry in the 
target design produced more rotation in the 
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S’s reproduced design than a rectangular 
(horizontal or vertical) line of symmetry. 

2. When the target design was presented 
as a diamond figure, there was more rotation 
than when it was presented as a square figure. 

3. When the target design was presented 
on a diamond ground, there was more rota- 
tion than when it was presented 
ground. 


4. Both figure and symmetry were more 
powerful than ground in Producing rotation. 
5. There was a substan 
lation between rotation a: 
of the Wechsler Bellevue, 


The present findings differ from Shapiro’s 
in certain respects: 


on a square 


tial negative corre- 
nd various subtests 


1. When intelligence scores were held con- 
stant, the difference in rotation for brain-in- 
jured and controls remained Statistically sig- 


nificant but was not great enough to be used 
for classification, 
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it is also increased when figure and ground 
are incongruent. 4 
3; Reducing peripheral vision increased p 
tation in controls, and appeared to ea 
rotation in the brain-injured. This er 
suggests that whereas the normal S po a 
uses peripheral cues as guides to on 
entation of his designs, the bralna ee 
may be confused and distracted by kr 
Masking his visual periphery assists 
than hinders him in orienting his design. 
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A Second Study of Psychological Changes During the 
First Year Following Prefrontal Lobotomy’ 


John F. Winne and Isidor W. Scherer 
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S x 

oe and his associates have published 
in a sam ‘ ai, 12) dealing with the changes 
ing Pren okt of schizophrenic patients follow- 
Teports th al lobotomy. The present paper 
utilizing e results of a similar experiment 

Barlie an independent sample. 
o atóm r studies of the effect of prefrontal 
Y on psychological test scores (1, 2, 
have yielded conflicting results. 
iscrepanc al, (12) suggested that part of this 
length of A might be due to differences in the 
esting, Othe interval between pre- and post- 
€ literat er factors, cited from a review of 
Tesults į E which might lead to conflicting 
rogencity uded lack of control subjects, het- 
Vs vari of the sample populations under 
failure t lations in the type of operation, and 
data, po Ptegrate test findings with clinical 
Proach 7 controlling these factors in an ap- 
of hypoth ich involved successive verification 
emonstrated (12, pp. 2-5) Scherer et al. 
3 out of ed presumably reliable changes in 

he ey total of 118 test measures. 

Peared to ults of the original experiment ap- 
Whi Support four generalized hypotheses 
stated briefly as follows: (a) 


? 
Scherer et 


Ich can be 


medi 

i ately following lobotomy there is a 
To; 

Northampton Veterans Administration Hospital, 
ne Drs 4 Mastarhinette, The authors wish to 
signet Dostd obert L, Fortier and Frank Politzer, 
Be ce in Thee trainees at this station, for as- 
yr Pattment a patients; Dr. Robert W. Baker, 
Di Wes, MD Psychology, Clark University, Lionel 
nel; esareo D. Chief, Professional Services, and 
in, q Trehub 3 Peña, Arthur S. Tamkin, and Ar- 
re Wallitative taff Clinical Psychologists, for judg- 
geet y Meser variables and critically reviewing this 
pon aver. S. Donald Isaac, Herbert Nickel, Jo- 
mo chologists and Alexander Stern, trainee Clinical 
Casures 4,2 for assistance in scoring quantitative 
and recording data. 


general decline in mental efficiency reflected 
in lowered test scores at two weeks following 
lobotomy. Full recovery from the decline ap- 
pears to take place by three months follow- 
ing lobotomy. At one year after the opera- 
tion, a trend toward reduced efficiency is again 
noted. (b) Tests measuring strength of ego 
boundaries show a steady increase throughout 
the first postoperative year. (c) There ap- 
pears to be greater sexual awareness and con- 
cern throughout all intervals during the first 
year following lobotomy. (d) Measures of 
rate of action and impulsivity suggest in- 
creased speed of reaction up to three months 
after lobotomy followed by a trend toward 
slower speed. 

Certain methodological shortcomings in the 
original study, however, cast some doubts on 
these findings. First, since not all subjects 
could be tested on all measures at each oc- 
use of lack of cooperation 
or unavailability of the subjects due to ill- 
ness, home visits, etc.—the sample utilized 
for the various comparisons of any single 
measure differed from one time interval to 
another. Second, it was found impossible to 
match experimental and control patients for 
preoperative performance on each test, al- 
though the groups were fairly well equated 
for such background data as age, education, 
length of hospitalization, level of cooperation, 
diagnostic classification, and certain behay- 
ioral characteristics (talkativeness, assaultive- 
ness, hallucinatory experiences, etc.). Third, 
it has been demonstrated (8, 15) that if one 
gives a large battery of tests to two groups of 
people and then examines the data in order 
to find differences between the groups, a cer- 
tain number of differences will be expected 


casion—either beca 
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Table 1 ! 


i ients 
Age, Chronicity, and Diagnostic Groups for the Lobotomized and Control Patien! 
a in the First and the Second Experiment 


Operated Patients Control Patients 
i Second 
Variable First Second First 3 
5 Bs 9) 
z2 > 5 37.1 (SE 2 
cis gee 33.9 (SE 1.3) 32.6 (SE 1.6) 30.4 (SE 1.0) ae 
‘ahi i 19 (SE2: 
EEn ia 4.1 (SE 0.5) 6.2 (SE 1.7) 3.3 (SE 0.4) 

Diagnostic Group ae 
Catatonic 36.4% 53.3% pe 20.0% 
Paranoid 22.7% 13.3% Zo 20.0% 
Hebephrenic 18.2% 20.0%, 91% 10.0% 
Mixed 22.7% 13.3% 36.4% 


to arise by the operation of chance factors 
alone. Thus, for example, of the 11 changes 
(each significant at the .10 level) in the di- 
rection of decreased mental efficiency two 
weeks following lobotomy, which Scherer re- 
ports in his Table 2 (12, p. 11), approxi- 


mately four of them might be chance rela- 
tionships. 


original experiment 
variations, to þe discuss 
in the experimental procedure, However, it 
was thought that if the effects of lobotomy 
are fundamental and far-reaching enough to 
show up in spite of these variations, this in- 
formation would certainly be useful. 


Subjects 
From a pool of 7 
Veterans Administration Centr. 


subjects were testable to any 
out the first year, These 25 į 
selected as subject 
this paper. The 15 lobotomized and 10 con- 
trol patients were fairly well matched f, 
diagnosis, chronicity, length of hosp 
tion, and a pro; 


at the 
history and symptomatology ogee age, 
time of operation.? Table 1 e o 
diagnostic classification, and c elie ; 
these patients as well as for those 
the first experiment. ve 
thous) 

An inspection of Table 1 indicates tos appro F 
the first sample of operated patients w they i ' 
mately the same age as the second aga rio 
been hospitalized for a considerably S differ Wi 
of time. The control samples, however, De secon 
respect to age as well as hospitalizatons a chron 
sample being drawn from a much “unpredictable 
Population. The difference was not | ve bee! 
since most of the potential control PE can Pe 
operated on before the start of the Le pit 
ment. The differences in age and length, of pS 
zation undoubtedly influenced the results 
logical testing. 

S second arais between the two bje RT 
is that of the motivation of the pakiet antral Pd 
the first study, 22 lobotomized and 2 16 opet he i 
tients were given pretesting. Of these, to take Je, 
and 18 controls were willing and able ss mP! 
test battery one year later. In the a Bin 
however, much more attrition occurre ‘nally t 
lobotomized and 24 control patients orig! 


«nents 
pene Jo 


any 0” of 
only 15 operated and 10 controls too press ig 
the entire series of tests. It was the speci as" 
the examiners, moreover, although no 


tal 

ple appeared to be genuinely interested A yab 0 jp 

tests and that the second control samp Jes US" 
The third difference between the say 

the two studies is found in the SE 

undergone by the lobotomized patien = 

reported in the Monograph (12) W gules 


sche eral 
? The prognostic index is derived rion cer 
B-1 and B-2 of the Veterans Adminis my 


si 
i ntrol pe 
exist to bear this out, that the original cO king 
A 
poto’ | 
Office Research Project on Prefrontal LO 


Changes Following Prefrontal Lobotomy 


Singes following an open Lyerly-Poppen approach 
ing the sae report dealt with changes follow- 
Scoville cKenzie approach (nine patients) and the 
Proach an roach (six patients). The McKenzie ap- 
spatula stitutes a McKenzie leucotome for the 
villes ee in the Lyerly-Poppen approach; Sco- 
rene ateral cortical undercutting is a radically 
Since operation, 
ferences Pater on of the data showed no gross dif- 
operations, the effects of the McKenzie and Scoville 
study, Ho the results were pooled for the present 
Suggest theres statements of nursing personnel 
less of fies the present sample of patients, regard- 
Mediate ch Ype of operation, showed much less im- 
did the Hee in behavior in ward situations than 
crepancy pa ients in the first experiment. The dis- 
clinical ‘status be due, in part, to differences in the 
i atus of the samples utilized in the two ex- 


Perime 
tive t nts, or, perhaps, to differences in the opera- 
echnique (5). 


AN Procedure 
ested gg patients were individually 
and E ior to, and two weeks, three months, 
iengo e Year following lobotomy. Control pa- 


tient. 
5 S Paar a 
interval ere individually tested at comparable 


rom the This represents a further deviation 
rabh a emenauns reported in the Mono- 
Were gro ); in the earlier study, all patients 
Present — whenever possible. In the 
two neti udy, however, since no more than 
Single ee were operated on during any 
Ot possible group administration of tests was 
Sults of to This probably influenced the re- 
Scherer esting, as has been suggested by 
tem age others (10, 13) in spite of an at- 
little tone the part of the examiners to be as 
Volved in the situation as possible. 


On, 
Psyc aa 


‘un, + :, " 
holo dred and six measures, derived from 27 


ag tests, were utilized in the lobotomy 
lictiong (cf. 12, pp. 6-10, 17). Specific empirical 
to „tical, Were derived from an analysis of the 
© the q> Significant changes in the first study as 
ou in of the net change in the operated 
pitta fs each of the test measures for each time 
Posttact nder consideration: (a) pretest-—two weeks 
Pete g pretest—three months posttest, (c) 
o tree ae year posttest, (d) two weeks posttest 
oe Year onths posttest, (e) two weeks posttest— 
o ar Posttest, and (f) three months posttest 
ee Seat: Each prediction was individually 
Lege in ascertaining the significance of the net 
the, 14 means using formula 7.25 of Walker and 
ie tl ee Since the earlier study suggested 
est Me Dae for the two samples could not be 
mi eted p e equal, the degrees of freedom were 
sett data” formula 7.26 (14, p. 158). Dichoto- 
lft i a were tested by using McNemar’s net 


Proportion (6, pp. 81-82), the entries in the 
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fourfold tables being the proportion of subjects pos- 
sessing the attribute in question. One-tailed tests 
were used throughout, with the level of acceptance 
being set in advance at p= .05. 


Results 


Two hundred and eleven specific predic- 
tions of net change for the operated group 
were empirically derived from the significant 
changes obtained in the original experiment 
(12).8 Of these, only 15 were accepted at the 
05 level of confidence, an outcome not sig- 
nificantly different from chance (x? = 3.7027, 
df= 6, p > 50). The outcome for each of 
the six time intervals under consideration was 
similar, as can be seen from Table 2. Those 
measures for which no prediction could be 
made, because they yielded no significant dif- 
ferences in the original experiment, also 
showed chance distributions of significant net 
changes. In view of the negative outcome, it 
was not felt worth while to examine in detail 
the status of the four generalized hypotheses 
of the Monograph (12). These hypotheses 
cannot be supported by the present study. 

The conclusion reached from these results 
is that the two samples of operated patients 
utilized in this series of experiments were not 
affected in the same way. It seems that the 
hypothesized effects of lobotomy, as found in 
the first sample, are not so fundamental as 
to appear despite the changes in experimen- 
tal procedure. The original conclusions de- 
rived from the Monograph (12) should be in- 
re, therefore, since it is quite 


terpreted with ca i 
possible that the original conclusions are spe- 


cific to’ the particular sample of patients un- 
der study and cannot be generalized to a uni- 
verse of lobotomized patients who may have 
undergone a variety of operative procedures. 


8 l iving, for each measure, the number of 
r a the predicted and obtained net 
change in the operated sample for the periods (a) 
pretest—two weeks posttest, (b) pretest—three 
months posttest, (c) pretest—one year posttest, (d) 
two weeks posttest—three months posttest, (e) two 
weeks posttest—one year posttest, and (f) three 
months posttest—one year posttest, have been de- 
posited with the American Documentation Institute. 
Order Document No. 4851 from ADI Auxiliary Pub- 
lications Project, Photoduplication Service, Library 
of Congress, Washington 25, D. C., remitting in ad- 
vance $2.00 for microfilm or $3.75 for photocopies. 
Make checks payable to Chief, Photoduplication 


Service, Library of Congress. 
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Table 2 
Outcome of 211 Empirical Predictions as to the Effect of Prefrontal Lobotomy 
Total Accepted Rejected Chi Square P 
Time Interval Predictions Predictions Predictions (df=1) 
Pre-Two Weeks = — 
"Expected 30.0 1.95 37.05 0.5950 >.25 
Obtained 39.0 3.00 36.00 
Pre-Three Months 
Expected 30.0 1.50 28.50 0.1753 >.50 
Obtained 30.0 1.00 29.00 
Pre-One Year 
Expected 32.0 1.60 30.40 0.1052 >.50 
Obtained 32.0 2.00 30.00 ý 
Two Weeks-Three Months 
Expected 42.0 2.10 39.90 1.8094 >.10 
Obtained 42.0 4.00 38.00 x 
Two Weeks-One Year 
Expected 33.0 1.65 31.35 0.0781 >.75 
Obtained 33.0 2.00 31.00 g 
Three Months-One Year 
Expected 35.0 1.75 33.25 25 
Obtained 350 30 oo 0.9397 >: 
Total o 
Expected 211.0 10.55 200.45 3.7027 aa 
Obtained 211.0 15.00 196.00 (df=6) 
: r x eri- 
Dhr hl Manges n the present sample were individually tested in the second exP 
rst year afti 


Summary 


A second study of the chan n 
; ` ges in F 
logical tests during the first ye; Psycho 


year following 
prefrontal lobotomy has been carried out with 
a sample of 15 operated Patients, 


all 

were individually tested Prior to, be ee 
weeks, three months, and one year following 
prefrontal lobotomy. Ten equated contro] pa- 
tients were individually tested at comparable 
intervals. 

The present sample differed ¢ 
from that used in the first study 
to length of hospitalization, mot 


type of operation. In addition, 


onsiderably 
with respect 
ivation, and 
all patients 


ment rather than being tested in a ered o 
The psychological test battery consis ` 
27 tests from which 106 measures were 
rived. Two hundred and eleven specific P 
dictions were derived from the results i 
earlier study (12) as to the direction a sis 
change in the operated group for each ost- 
time intervals: (a) pretest—two wets Pr 
test, (b) pretest—three months posie i RS 
Pretest—one year posttest, (d) two tw 
Posttest—three months posttest, (€ a () 
weeks posttest—one year posttest, a” test 
three months posttest—one year pos ind 
Each prediction was tested by acer og 
the statistical significance of the net © data: 
in means, or, in the case of dichotomized al 
the net shift in proportion of the indiv! we 
Possessing the attribute. One-tailed tests eve! 
used throughout the analysis with we e 
of acceptance being set in advance 4 
3? = .05 level, 


The conclusions of the study were aS 
lows: 


rer 
an 


Š Ji 
(2) only 15 out of 211 specific p'° 


Changes Following Prefrontal Lobotomy 


tions were accepted (4p = -05), an outcome 
not significantly different from chance. (b) 
These results suggest that the hypothesized 
effects of lobotomy, as found in the first ex- 
periment, are not so far-reaching as to appear 
despite the variations in experimental pro- 
cedure. (c) While a further study of changes 
beyond the first postoperative year might 
have been extremely valuable, it is not being 
carried out, since it would yield relatively 
little information as to the effect of lobotomy 
in the present sample because of the increas- 
ingly routine use of chemotherapeutic pro- 
cedures with both lobotomized and non- 
lobotomized patients. 
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A Note on Research Methodology Used in Testing 
for Examiner Influence in Clinical Test Performance 


Leon H. Levy 


Indiana University 


This note presents a brief methodological 
critique of research concerned with the prob- 
lem of how much of the variance in clinical 
test performance may be accounted for by 
the personality characteristics of the ex- 
aminer (E). 

The extent of actual research concerned 
directly with this problem is quite limited 
and with the exception of Lord’s study (2), 
each of these makes use ofa simple-random- 
ized design ( 1). This design is cha: 
by the random assignment of subj 


randomized 


re 
data are used it is doubtful Whether 
randomization ever obtains; where 
signed at random the Possibility of 
ject differences still exists since 
tion at best reduces the likelihood 


adequate 
Ss are as- 

intersub- 
tandomiza- 
of bias but 


does not completely control it. A ae 
limitation of this design is its failure to t i 
interaction effects into account. Since it ers 
seem highly unlikely that these do not er 
in this area, data thus far accumulated a 
not be adequately interpreted until they 
known. i 
If case file data are to be used and of 
Willing to forego investigation and contro g 
interaction effects, a paired-replicates dez ; 
or treatments-by-levels design may be U es- 
This would obviate to some extent the ee 
sity of assuming initial random case ER 
ment. The important requirement here Tie 
be that Ss in each of the Z groups be marg 
on psychologically meaningful variables. con- 
Where the experimenter has complete di- 
trol over S selection and assignment, 1n night 
tion to the paired-replicates design he i 
also use a random replications design do 
This design further reduces the ikelite y 
sampling error and permits some contro 
interaction effects through randomization fe 
Finally, although several other exper) telY 
tal designs could be used more legim d 
than the simple-randomized design, it Ti 
Seem that because of the likelihood an m! 
Portance of interaction effects and in té de- 
of the amount of information yielded, ary ign 
sign other than some type of factorial orts 
must be considered profligate of time, © 
and data. 
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The Examiner as an Inhibiting Factor in 
Clinical Testing 


Lewis Bernstein * 
Veterans Administration Hospital, Denver, Colorado 


Thi 
ma ee attempted a simultaneous in- 
fon, ont fhe i tent administra- 
Were oral eae interaction. The factors studied 
TAT, 4nd vs. written administration of the 
Seite i the effects of the presence or ab- 
methods pp examiner under each of these 
In thet administration. , 
investigat a studies which have previously 
of the TA oral vs. written administration 
administ T (3, 8), the oral condition was 
conditio ered individually, and the written 
OF e was administered in group form. 
tered es Eron and Ritter (3) adminis- 
with two written condition to groups of six, 
cards, In oad sharing one set of TAT 
eS addition to the unknown effects of 
taminatin situation, we have the further con- 
two hie factor of the interaction of the 
Gie using the same set of cards. 
tion Wiser a the individual oral administra- 
With no oe to standard directions, 
administratio limit, while the written group 
minutes ion imposed a time limit of five 
OWever = card. It must be pointed out, 
Ritter’s st a the conditions of Eron and 
interested 1 y were necessary since they were 
Method co pp determining whether the group 
Mg norm uld economically be used in gather- 
ji Ce Ta data. However, the two forms 
or q e on are not strictly comparable 
Written peal the relative usefulness of 
would s. oral stories in a clinical situation. 
Need for appear, then, that there remains a 
Stories comparing oral vs. written TAT 
, both administered individually. 


H. Dana 


1 Th 
for }, © author is indebted to Dr. Richard 
Thanks 


are ae in the collection of the data. 

raters: Pani to the following persons who served as 

Sbs R. Binner, A. Frank Knotts, Mrs. Nancy 
nson, and Robert A. Spicer. 


As to the need for i igati 
of the presence or a I st 
test protocols, Sells (7) has reported that 
Rorschach responses appeared quite unin- 
hibited in the group test (with relative ab- 
sence of the examiner), but controlled in the 
individual administration. He goes on to state 
that “. . . one important hypothesis requir- 
ing careful study is that the presence of an 
examiner in the clinical test may inhibit the 
reporting of highly emotional content” (7. 
p. 25). g 

In this study, then, by using a 2 X 2 fac- 
torial design (1), we were able to investigate 
these two factors, as well as their interaction 
which potentially could be of even more sig- 
nificance than the individual factors them- 


selves. 
Method 


The subjects were 67 female college stu- 
dents—the entire sophomore class of the Uni- 
versity of Colorado School of Nursing. The 
subjects were randomized into four groups: 
(a) Oral, examiner absent; (b) Oral, ex- 
aminer present; (c) Written, examiner ab- 
sent; (d) Written, examiner present. There 
were two examiners—one was the subjects’ 
psychology instructor, the other completely 
unknown to any of the subjects prior to the 
experiment.” 

Subjects in all conditions were shown into 
office and were told they would find 


a private 
for what they were to do and the 


directions 


2The small number of examiners in this study 
does not fulfill the requirements of representative de- 
sign, as suggested by Hammond (5), and the con- 
clusions will therefore be limited to the two ex. 
aminers in this study until the number of ners 
has been increased. EES 
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aterials on the desk. On each desk 
os Ee TAT cards turned face down 
with card one on top. The cards were the 
third revision, and included all twenty pic- 
tures recommended by Murray (6) for use 
with adult females. The following directions 


for all subjects were typewritten on individual 
cards: 


This is a task which you should fin 


d interesting. 
On the table before you is a 


set of pictures which 
ime, and make up as 
or each one. Tell what 
wn in the picture, de- 
the moment, and then 


When you get to Card N 
a blank card. Imagine a Pi 


Picture. 


Be sure to number your stories t 
the numbers on the cards, 


re to be assigned to the 
given gri 


Lewis Bernstein 


a pad of paper and pencils or a a oe 
machine, depending on the experimenta. eee 
dition. The only difference between the a 
aminer-present and examiner-absent con 
tions was that in the eratiiter present 
situation, one of the examiners sat ac a 
the desk from the subject throughout 
session. 

Each story was coded and typed re of 
duplicating stencil so that comparable se Ai 
Stories could be presented to the ok 
Stories were rated on Eron, Terry, and o 
lahan’s scale for emotional tone (4) ‘i 
Eron’s scale for outcomes (2); and on T 
scale for level of response (9). Only one ies 
able was rated at a time and all the sto 
for a given picture were rated together. o 
stories were independently rated by yete 
judges. Pearson + reliability coefficients i 
-88 for emotional tone, .82 for outcomes, 

‘83 for level of response. 


Results ns 

Table 1 shows the differences in the mour 

for the three scales under each of the cale, 

conditions of administration, For each $ sig- 

the examiner-absent condition yielded niner- 

nificantly higher mean than the exa! were 
present condition, whether the stories 


Table 1 
Differences in Means for All Scales 
Oral, Oral, Wri i 
l ; tten, 
Examiner Examiner EnA pau, 
Variable (ety e me passent eren 
=17) (V=16) (W=18) (N =16) Difference 
Emotional Tone 17.06 —11.13 5.93 er 
~17, : i J 
7.06 ~17.33 27 4D ae 
~11.13 ~10.25 88 4.19" 
~17.33 —10.25 7.08 + 
Outcomes =871 A 
. +3.69 : 
-871 12.40 67 
zale —6.61 2.10 00 s 
.69 +3.69 .00 4.68" 
—6.61 +3.69 10.30 + 
Level of Response 68.47 203 
58.50 g 3 
68.47 63.61 28 E 
58.50 i i 


fa: 
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Table 2 


Summary of Analysis of Variance 


: Source of Mean 
Variable Variation df Square F 
Emotional Oral vs. Written 1 55 017 
one Exam. abs. vs. 
Exam. pres. 1 708.99 21.193*** 
Interaction 1 6.30 188 
Within groups 63 33.45 
Total 66 
Outcomes Oralvs. Written 1 14.55 228 
Exam. abs. vs. 
Exam. pres. 1 2140.59 33.541*** 
Interaction 1 23.81 373 
Within groups 63 63.82 
Total 66 
ae of Oralvs. Written 1 5153 761 
Ponse Exam. abs. vs. 
Exam. pres. 1 748.81 11.062** 
Interaction 1 177.67 2.625 
Within groups 63 67.69 


Total 66 


Note. f s 
ance is pii case the hypothesis of homogeneity of vari- 


eh Sienificant at the .01 level of confidence. 
‘nificant at the .001 level of confidence. 


wai 4 written (with the exception of the 
Were n Stories for level of response). There 
and a significant differences between oral 
wheth titten stories for any of the scales, 
er the examiner was present or absent. 
wae 2 shows the results of the analysis 
Mlance for each scale. In each case, the 
Y significant F was for the examiner-ab- 
Vs. examiner-present condition. There 
two tenes Significant interaction between the 
€sting factors studied. 


Was 


Discussion 


a has been demonstrated, within the limits 
able 1s experiment, that there is no apprec 
Oral] ifference between TAT stories given 
Derim, or written by the subjects in this ex- 
and et as far as emotional tone, outcomes, 
Ever evel of response are concerned. How- 

re $ oa the examiner absent the stories 

Breate der, have sadder outcomes, and show 
ject ie me on the part of the sub- 

+» These findings clearly support Sells’ sug- 
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gestion that the presence of an examiner may 
inhibit highly emotional content (7). It was 
noted by the examiners in the present study 
that subjects frequently looked up to see if 
the examiner was being attentive; and in the 
written condition, many subjects put their 
completed stories under the pad of paper, as 
if to assure that the examiner could not read 
them. 

However, the mere physical absence of the 
examiner may not be the important variable. 
It seems more likely that what may be op- 
erative is the subject’s expectancy for im- 
mediate evaluation. For example, Terry (8) 
reported a significantly higher level of re- 
sponse for individually administered TAT 
stories than for those given by written group- 
administration. Although the examiner was 
relatively absent from the group administra- 
tion, she noted that “After completion of the 
first story all subjects were reminded of the 
directions if they had omitted any part of the 
story, such as the ending, or what had hap- 
pened before to the characters” (8, p. 14). 
What may have happened here is that the 
subjects, after having had their first story 
evaluated by the examiner, expected that 
further evaluation might follow. On the other 
hand, this expectancy was apparently not cre- 
ated in the group administration of the Ror- 
schach reported by Sells (7). In the present 
study, the examiner did not read or hear any 
of the stories given in the examiner-absent 
condition until the subject had left the ex- 
amining room. In other words, it is tenta- 
tively proposed that the creation of an ex- 


y for immediate evaluation, even if 


pectanc : 
further evaluation does not in fact occur, 


changes the testing-field situation for the sub- 
ject from one of examiner-absent to examiner- 
present. It is planned to study this possibility 
in future experiments. 
Summary 

Sixty-seven female college sophomores were 
randomized into four groups for administra- 
tion of the TAT under the following condi- 
tions: oral, examiner absent; oral, examiner 
present; written, examiner absent; and writ- 
ten, examiner present. The resulting 1,340 
stories were rated for emotional tone, out- 
comes, and level of response. Analysis of 
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variance indicated that the only significant 
difference in the stories on each scale was a 
function of the presence or absence of the 
examiner, with the examiner-absent condition 
yielding higher means on each of the scales. 
There were no apparent differences between 
written and oral stories, nor was there any 
significant interaction between the two vari- 
ables studied. 

The data support the hypothesis that the 
presence of an examiner jn a test situation 
acts as an inhibiting factor for strongly emo- 
tional material. It was Suggested that the 
variable operative may not have been the 
mere physical presence or absence of the ex- 
aminer, but rather an expectancy created in 
the subject for either immediate or more re- 
mote evaluation of his productions, 
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An Effect of the Situation on Psychological Testing 


E. Jerry Phares 
Kansas State College 


and Julian B. Rotter 
The Ohio State University 


a Na recent studies have begun to 
Psycholot ba role of situational variables in 
ables EGA testing (1, 2, 3, 6): Such vari- 
tions ne. e the examiner, the test instruc- 
place af t the set of the examinee, and the 
effective] esting. Although these studies have 
such oi demonstrated the importance of 
asis for a they have not provided a 
Of the nat e regular or systematic prediction 
Ormance ee and amount of variation in per- 
Social 1 ue to such variables. 
esis that earning theory provides the hypoth- 
tional ki e useful way to characterize situa- 
is in A ARAS and their effect on behavior 
reinforcem of the expectancies they arouse for 
ticular RE The expectancy that a par- 
ticular be orcement will follow from a par- 
Specific ee is in part a function of the 
Particular uation and the expectancy that a 
ater ia oraenen will be followed by 
of the sit © reinforcements is also a function 
of these fia More detailed descriptions 
Rotter (4, 5) ionships have been made by 
a stated, situations provide cues for 
elayeq i ate ee both immediate and 
um grati A ehavior is directed toward maxi- 
e shoul a er (or minimum punishment) 
Characteristic able to predict that behaviors 
i rg directed toward particular 
Negative r ents (or away from in the case of 
© occur n forcenientE) would be most likely 
on n situations which we can identify 
like}. p basis of previous experience as most 
tion © provide the reinforcements in ques- 


[> 


Alt : 
toma this is a simple, common-sense 
ion, it has not been put to work 


systematically in attempting to predict the 
effect of such variables as the personality or 
sex of the examiner or the time and place 
of testing for either clinical or experimental 
testing. Many failures to duplicate test re- 
sults both in clinical work and in experi- 
mental investigations have been ascribed to 
unreliability in the subjects or test instru- 
ments rather than to differences in the test- 
ing situation. 

The present study is an attempt to test the 
hypothesis that the preference values of a list 
of reinforcements will differ predictively de- 
pending upon the situation in which they 
are obtained when random groups of sub- 
jects drawn from the same population are 
used. 

More specifically, it was hypothesized that 
differences greater than chance would be 
found in the rankings of three kinds of re- 
wards—judged to be academic achievement 
rewards, athletic achievement rewards, and 
manual skill rewards—when obtained in an 
English class, a gymnasium, and a wood- 


working glass by the respective instructors in 
ypothesized that aca- 


those classes. It was hi 
demic achievement reinforcements would be 


rated by subjects to have higher value in the 
English class, athletic achievement in the 
gymnasium, and manual and mechanical skill 
achievement rewards in the woodworking 
class. This study was also undertaken to ex- 
plore one methodology for determining the 
significance of the psychological situation. 


Procedure 


It was important that the items provided 
for ranking should all be of approximately 
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equal value; this value being moderate. Re- 
inforcements of moderate value would be free 
to move either up or down in value as the sit- 
uation changed. Three lists of reinforcements 
(each containing 10 Athletic, 10 Academic, 
and 10 Manual reinforcements in random 
order) were constructed. Each reinforcement 
had previously been unanimously categorized 
as exclusively either Manual (M), Academic 
(Ac), or Athletic (4£) by five judges. Three 
groups of male seventh and eighth graders 
(comprising a total of 99 subjects), were 
asked to categorize each item under one of 
five headings: (1) Like hardly at all; (2) 
Like some; (3) Like pretty well; 
lot; and (5) Like very much. The subjects 


research, and Contained such p 
items as, “Be Praised b 
ing a good book report,” “Have your friend 
admire you for getting good grades,” “win a 
wrestling match with a friend,” “Kı i 


about baseball than the oth Now more 


er guys,” “Get a 


E. Jerry Phares and Julian B. Rotter 


tool set for Christmas,” “Win a prize for 


. n i 
building the best magazine stand in school. 


Subjects for the final phase of the ee 
ment were 78 eighth-grade and 72 seventl f 
grade boys, all from the same school. Each 0 


the three situations, English classes (Aca- 


demic), gym classes (Athletic), and bie 
working classes (Manual), were wee 
classes for all male students of the we 
Fifty different subjects ranked the list of F 
inforcement items in each situation. In ‘a 
three situations, the ranking procedure W y 
not initiated until the classes had been paa 
way for at least ten minutes, to help e 
the representativeness of the situations. ne 
the English classes, the ranking was done 
with the subjects seated at their desks; see m 
8ym classes the subjects were clad in mt - 
clothes and seated on bleachers; in the “king 
working classes the subjects did the la 
at their benches. In every case, the partici ce 
Class instructor administered the list. se 

all were required courses it was felt that ex 
Samples of subjects in each situation ee 
large enough to ensure random selection 


. 00! 
Seventh and eighth graders for this sch 
Population. 


Results 


The mean ranks for the three group” 
reinforcement in each situation are show the 
Table 1. The lower the score the higher 
Preference, rein 

Reliability coefficients for the list of even 
forcements were computed by the o eat 
method and corrected by the Brown- T re- 
man formula. They were .79 for Athlet! 91 
inforcements in the Athletic situation: ic 
for Academic reinforcements in the Aca ts iP 
Situation; .83 for Manual reinforceme™ 
the Manual situation. 


of 
in 


Table 1 


a r ent 
Comparison of Mean Ranks of Reinforce™ 
Items in Three Situations 


Situation 3 situ” 
tons 
Items Academic Athletic Manual 9.61 
Academic 9.54 1021 9.26 9.38 
Athletic 983 840 9.90 941 
Manual 9.12 9.82 9.28 


Effect of the Situation on Psychological Testing 


Table 2 


Significance of Differences of Means of Pairs of 
Reinforcements for Two Situations 


Situation and 


reinforcements Difference * 
Academic vs. Athletic 2.10 <.001 
Athletic vs. Manual 2.04 <.001 
Manual vs. Academic At >.10 


Kiii — 5 
dine? {alues based on a one-tailed test of significance, since 
n as well as change was predicted. 


in Since the differences between mean rank- 
ey were slight, difference scores were used 
ea the hypothesis by calculating the sig- 
ent aac of (a) the difference between mean 
‘ores: or the Academic and Athletic rein- 
ments in the Academic situation as com- 
med with that difference in the Athletic 
ie tt (b) the difference between mean 
ment of the Manual and Athletic reinforce- 
with phat the Manual situation as compared 
and at difference in the Athletic situation; 
of an the difference between mean ranks 
in fe Manual and Academic reinforcements 
that ee situation as compared with 
ata ifference in the Academic situation. The 

tè are shown in Table 2. 
aa be seen that significant results were 
e Ma the case of (a), differences between 
ese letic and Academic reinforcements 1n 
i situations and (b), differences be- 
ment the Athletic and Manual reinforce- 
iffer in these two situations. No significant 
e naea however, were obtained between 
eas of (c), Academic and Manual 

rcements in these two situations. 

Sine latter failure to demonstrate differ- 
he ety be partially explained, it is felt, on 
Wo asis of the greater similarity of these 
situations (M and Ac) as compared with 
fare etic situation, which contained rather 
after ctive cues. An additional explanation 
Such bi ose hoc analysis of the Manual items, 
around “Fave your dad let you tinker 
ievel with his car,” and “Work on your 
em haces school,” showed that several of 
on i ad little in common with what went 
in the woodworking classes and did not 
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as it was presumed, involve similar skills to 
those rewarded in a woodworking class. 


Discussion 


The results show that two of the three 
predicted differences occurred to a significant 
degree. Although the specific test responses 
studied may not be of great significance in 
themselves, the study suggests that such rela- 
tively unimportant variables as the physical 
setting of the testing and the subjects’ pre- 
sumed characterization of the examiner (Eng- 
lish teacher, gym teacher, etc.) may generally 
have demonstrable effects on test results. It 
seems likely that similar effects may occur if 
the subject is a hospital patient and sees the 
examiner as some one in authority or not, or 
if in a typical experiment the subjects pre- 
sume that the experimenter is an instructor 
or a graduate student, or if they anticipate 
that the examiner is one who can provide 
them with help, or appears to appreciate 
social skills more than intellectual ones, etc. 
In other words, the present study lends some 
support to the hypothesis that in both clinical 
and experimental testing, the group or in- 
dividual subject’s behavior must be appraised 
in light of the reinforcements they expect to 
e likely to occur in the particular situ- 
ovided by the physical setting and the 
r, as well as by the test instructions. 


be mor 
ation pr 
examine 
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The Relationship of the Pr 


ogtessive Matrices (1938) 


and the Columbia Mental Maturity Scale to the WISC 


Ernest S. 


University of 


Since its clinical inception in 1949, the 
Wechsler Intelligence Scale for Children 
(WISC) (5) has become one of the leading 
tests for measuring the general intellectual 
level of children. Two other scales, the Pro- 
gressive Matrices (PM) (4) and the Colum- 
bia Mental Maturity Scale (CMMS) (1), 
are becoming increasingly popular measuring 


instruments of the general reasoning ability 
of children, 


revision), 
be considered “asa 
Teasoning Processes” 
of nonverbal Teasonin, 


Barratt 


Delaware 


were followed, with one exception, i.e., in = 
ministering the PM, the test was SODH 2 
When a subject missed six consecutive i "o. 
The age range of the children was Hom A 
years to 10.1 years. The children came 

both rural and urban homes. There wre ed 
boys and 34 girls in the study. The 193 peen 
tion of the PM was used since it S dren 
the author’s experience that in testing chi ape 
of 8 years and older, sufficient variance s 
tained with the 1938 edition to obviate 

stituting the 1947 revision of the PM. 


Results and Discussion dard 
Table 1 contains the means and standa” 


in 
deviations (SD) for the various tests used ; 


in 
this study. The WISC means and SDs até 
Table 1 


Means and Standard Deviations of the 
WISC, PM, and CMMS 


SD 
ability, Test Mean 
Since th i WISC* 8.02 
deine a entire WISC cannot always be Total 108.92 ren 
administered because of time limitations or Verbal 35-14 8.68 
physical handicaps of the subject, it would be Performance a 295 
helpful to know to what extent the PM Information 11.04 3.68 
CMMS could be substituted for it The ii A iarehension P f 
pose of the present study is to note the fata, Sinisa 1159 3 
tionship of the WISC to the CMMs and PM ocabulary 10.81 236 j 
Digit Span 10.17 3.31 
Procedure Picture Completion ve at 
s $ icture Arrangement 11. 3. 
Seventy children, the entire fourth-grade Block Dien e 10.82 2.46 
enrollment in the Medill Elementary Schoo] Coiect Assembly nrs 26 
Newark, Delaware, were given the WIsc’ seat a 265 
PM (1938), and CMMS as individually ag. PM S 24.11 338 
ministered tests. The directions in the re. CMMS 78.37 
spective manuals for ad 


ministering the tests 
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* All WISC scores are Scaled Score Units (5). 


e 
X _Wis 


y 


7 


) 


Progressive Matrices, Columbia MMS, and WISC 


sore uns facts comparing he 
— Haag e with the original standardiza- 
standardiz igi = 10, SD =3 for WISC 
rent WIsc ion subtests). Although the cur- 
aes subtest means are slightly above 
ardizati compared to the original WISC stand- 
cf none of the deviations are 
the tet, pear from 10. The ¢ ratio for 
12.30) is eviation from 10 (arithmetic, 
test SD approximately 1.1. The WISC sub- 
a from 2.36 (digit span) to 3.68 
SDs pension) with the average of the 
better a The subjects did slightly 
ormance e verbal scales than on the per- 
Performa: scales but were less variable on the 
The ay scales. 
c Pl oa pi of 24.11 corresponds to a 
standardi: cal age (CA) of 9.5 years in the 
Nios ik eG 12). The PM 
i i tee study is 3 to 43; the SD 
and lear a the 1947 Colored PM, Green 
© 35 and ee p. 140) obtained a range of 9 
obtained a artin and Wiechers (3, p. 144) 
age grou range of 8 to 35 with comparable 
e 1938 Ene is this author’s opinion that 
ability at provides a better differentiation 
Evision of = extremes than does the 1947 
yeats the PM with children above a CA 
Th i 
sponds is mean in this study corre- 
of aa mental age of 12 years, and an 
B 8), Aiea the standardization sample (1, 
Indicate t ough the authors of the CMMS 
group on hat the IQs of the standardization 
Saaie CMMS correspond to their 
as consi ea IQs (1, p. 11), the CMMS 
either he Eee yielded higher IQs than 
dlawa inet or WISC in the University 
` Table e Laboratory Clinic. 
tions of th contains the uncorrected correla- 
The py- EM and CMMS with the WISC. 
c Par significantly related to the 
to all of verbal, and performance scores 
Te hension the WISC subtests except Com- 
he PM-WI Considering the rank order of 
highest wi SC subtest rs, the PM correlates 
Soning Phen those tests involving spatial rea- 
Te or ES designs), verbal reasoning of a 
and ac es abstract nature (similarities), 
Vocabula ired knowledge (information and 
ions wit, ). The PM has the lowest correla- 
tests that involve reasoning in a 


of 


Table 2 


The Relationship of the Wechsler Intelligence Scale 
for Children to the PM and CMMS 


WISC CMMS PM 
Total * 754" 
Verbal = oe 
Performance ‘A78* 699" 
Information “129 '585* 
Comprehension 330" ‘075 
Arithmetic 680" ‘540° 
Similarities 425" ‘589* 
Vocabulary ‘452* ‘561* 
Digit Span ‘272** 419" 
Picture Completion 3 A15* 
Picture Arrangement .484* .300* 
Block Design 473* .601* 
Object Assembly „zast .388* 
Coding A42* wan" 
eee 642" 323* 
CMMS 576* 


* 1% level of confidence, 

#* 5% level of confidence. 
cultural context (comprehension, picture ar- 
rangement) and tests involving perceptual 
speed and psychomotor tasks (coding, mazes). 

The CMMS was also significantly related 
to the WISC total, verbal, and performance 
scores and to all of the WISC subtests except 
information. Ranking the CMMS-WISC sub- 
test rs, it is difficult to interpret some of the 
rs. The CMMS had a higher 7 with arithmetic 
than any other subtest; since numerical con- 
cepts (counting, relative length, relative size, 
etc.) are involved in many of the CMMS 
items, this is not surprising. It is difficult, 
however, to account for the high r between 
the CMMS and mazes. The author could 


think of no logical connection between the 


problem-solving behavior required for solving 
s that could not 


the CMMS and maze item: 
also apply to some of the other, lower sub- 


test CMMS 7s. 
The PM correlated higher than the CMMS 


with the WISC total, performance, and verbal 
scores. About 57 per cent of the WISC total 
variance was in common with the PM, while 
only 36 per cent of the WISC total variance 
was in common with the CMMS. At the age 
level of the subjects in the current study, the 
PM appears to be a more appropriate substi- 
tution than the CMMS for the WISC total 


score. 
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Summary and Conclusions 


The Columbia Mental Maturity Scale 
(CMMS) and the Progressive Matrices 
(1938) (PM) were related to the WISC. 
Seventy fourth-grade children were tested. 
Both the PM and the CMMS were signifi- 
cantly related to the WISC total, verbal, and 
performance scores. The PM had more vari- 
ance in common with the WISC total score 
than the CMMS. The relationship of the PM 


and CMMS to the WISC subtests was also 
discussed. 
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Pre-Illness Intelligence of Mental Hospital Patients” 


Charles F. Mason 


Purdue University 3 


In 

th oo Sipra dune course in which the 
raised oh enrolled the question was once 
etween ont y ether there is any relationship 
ment, The elligence and psychological adjust- 
actually ala replied that no one could 
studies Maa er the question because relevant 
Bence of m ect had to measure intelli- 
ecome il] aladjusted persons after they had 
clinic, Tt ei to appear in a hospital or 
questios wS speculated at the time that the 
Utgrowth ys ultimately be answered as an 
urement g of some plan of mass mental meas- 
uring W, uch as the testing of all draftees 
the writ orld War II. A few years later, when 
chology ae a VA trainee in clinical psy- 
realized th is point was recalled and it was 
‘9 obtain at he was in a favorable position 
illness) į pre-illness (or at any rate pre-acute- 
eet scores of a large number 

inet iatric patients. 
ered as Psychiatric patients can be consid- 
quate oe who have failed to make ade- 
ing t ty ona adjustments, by examin- 
Scores (th rmy General Classification Test 
; „and 9 AGCT is described in references 
ences abo ) we would be able to make infer- 
and Sage relationship between intelligence 
nner th ological adjustment in the same 
&tween = we might study the relationship 
Mining ie pa and scholarship by eX 
F's in e IQ scores of students who made 
Story, Na It would not be the whole 
> but would be a beginning. Further, in- 


Thi 


rE 
., this 
Mitteg ertation sub- 


bi mee is based upon a diss 
GWitements for eng in partial fulfillment of the e- 
Writer ig ; for the Ph.D. degree in psychology- The 
is critica weet to Professor John M. Hadley for 
Ni törn and helpful service. 

Arion Veterans Administra! 


Now 
“ong 


tion Hospital, 


at the Veterans Administration Hospital, 


Beach, California. 


formation about how persons who are now 
psychiatric patients performed on an intelli- 
gence test given before they became patients 
is important to the body of psychological 
knowledge. The performance of patients in 
different diagnostic groups would also be im- 
portant to ascertain. 

Investigation as to the practicality of the 
closed that VA installations could 
obtain the AGCT scores of patients by send- 
ing a form to the Army. To fill out these 
forms for a large number of cases certainly 
posed a long and monotonous task, but it was 
decided to be worth the effort, and the study 
was undertaken. The project was carried out 
at the VA neuropsychiatric hospital at 


Marion, Indiana. 
Planning the Study 
In the literature pertinent to the question 
of relationship between intelligence and psy- 
t, three general types of 


chological adjustmen 1 
hypotheses were found to predominate. These 
were: (a) that there is a direct, positive re- 


lationship between intelligence and psycho- 
logical adjustment; (b) that a particular in- 
telligence level is optimal for adjustment in 
our society; (c) that patients 1n certain psy- 
chiatric diagnostic groups are brighter than 
those in others. These hypotheses led to the 
choice of chi square as the appropriate sta- 
tistic for the present study. 

Jf intelligence and adjustment are posi- 
tively related, comparing AGCT scores of 
mental patients to those of controls by chi 
square should show that this maladjusted 
group had scored lower than the normals. In 
addition, inspection of the chi-square table 
would reveal any range of intelligence with 
low representation among patients, in accord- 
ance with the hypothesis of an optimal range 


project dis 
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of intelligence for adjustment. Each diagnostic 
group could be compared separately to con- 
trols by chi square to determine whether the 
group had scored significantly low or high on 
the AGCT. 

The literature provided further guidelines 
in the plan of our study. That careful atten- 
tion to design was necessary was shown by 
Lorge’s review of studies of intelligence and 
adjustment, published in 1940 (6). He found 
a range of correlation coefficients from minus 
-49 to plus .70, with a median of .04. Of these 
findings he says that the range is so “extra- 
ordinary that anybody can make any state- 
ment.” Such diverse findings must come from 
differences in experimental design. Spragg 
(7) and Williams (11) have discussed typi- 
cal defects of design which apply to many 
relevant studies. Small sample and inade- 
quate controls are frequent limitations, and 
fortunately bountiful and adequate data were 
available for the Present project, 


Collecting the Data 


290,163 Fifth Seryj 
ductees, so Seographi 
constant. However, 


cure, which robs our 

» Dut it wa 
enter any practical bias, 
The experimental sam, i 
ple consisted of 

AGCT scores of Worl o So 

rld War II, male, Army 

i Larger class intervals Were used in 

. These distributi 
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veterans, who were or had been hospitalized 
at VA, Marion, and diagnosed by a staff 0 
two or more psychiatrists as suffering es 
functional psychiatric disorders. The = 
was obtained by drawing randomly from E 
hospital’s register and rejecting cases whic 
did not meet the criteria. E 
In discussion of the project with env 
the writer found a very pertinent question n 
quently raised. Suppose some of the panera 
AGCT scores were lowered by acute iness 
the time of taking the test? A substudy 7 
signed to check this hypothesis was made. A 
analysis of variance it tested the assumpto 
that subjects who had been hospitalized sail 
schizophrenia shortly after taking the ca 
would tend to have scored lower than a 
Phrenics hospitalized after a longer inte e 
ing period of duty. This investigation y!¢ <a 
nO support for the hypothesis, so there 
no further screening of the data. 


Results 


+ eethyttioDs 

Figure 1 shows graphically the distributa 
for the experimental sample of AGCT tio? 
of 510 patients and the control distributis 
based on scores of 290,163 Fifth re re- 
Command inductees. Table 1 presents t sb 
sults of comparing these two distribution” n- 
chi square as well as comparisons to ss for 
trol data of distributions of AGCT score 
various diagnostic subgroups. c 

The patients were not found to have j s 
lower on the AGCT to an extent that y total 
tistically significant. Schizophrenics, a5 4 © pjs 
SOUP, scored significantly low. However, j20" 
Tesult is misleading, since study of 5 nd 
Phrenic types reveals that the parano of 
catatonic types did not score low. In he: Gs 
the often encountered statement that i it 
quires high intelligence to be parano, the 
might be well to underline the fact tha no 
paranoid schizophrenic group showe t 
tendency whatever toward higher scores sive 
the control group. The manic-dep" o ed 
Stroup, though including only 25 cases; $ rend 
a statistically significant high scoring 


ored 


Discussion 


the 
1. Two conclusions may be drawn fro et 
comparison of the total sample of pē 


| 
: 


| 


| 
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50 


40 


30 


FREQUENCY 


20 


aT 57 67 
MID- 
Fig. 1. Distribution © 


tients (solid) and control distril 
ice Command inductees (broken). 


Scor 

adh yee control data: First, no signifi- 
JUstment pon between intelligence and ad- 
‘ave Showt shown. One might remark that we 
lsr 86 chances in 100 that “mentally 
the — tend to have scored lower than 
that o population. However, the facts 
Maladjust sample represents an extreme of 
tricity js a and that most of its eccen- 
Suggest t ue to certain schizophrenic types 
z o the writer that, if a single con- 


77 87 97 107 n7 
POINTS OF STANDARD SCORE CLASS 
{ AGCT standard scores for 510 p: 
‘bution based on data for 290, 
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147 157 


7 137 
INTERVALS 
sychiatric inpa- 
163 Fifth Serv- 


nd between this and intelligence would 
be negligible. Second, it is concluded that no 
particular level of intelligence is revealed as 
optimal for psychological adjustment (no re- 
stricted range along the intelligence con- 
tinuum showed a low incidence in this sam- 
Je of scores of maladjusted persons). It 
should be stated that this latter point has no 
bearing on the hypothesis of Hollingworth 
thesis involves intelligence lev- 


(4). Her hypo 
els above IQ 130, which this study could not 


be fou 


Muum, « E 
the total ee ater were extended into l n 
- S. population, any relationship to adequately sample. Thus our findings relative 
Table 1 
Chi-square Results: Comparisons to Control Data of AGCT Data for All Patients 
and for Diagnostic Subgroups 
Group N df Chi square È Trend 
All patients 22.32 14 
510 16 . 
All schizophrenics 368 16 32.60 02 Low scores 
Paranoid 66 3 3.10 39 
Catatonic 126 7 10.61 19 
Hebephrenic 122 7 17.55 .02 Low scores 
Simple 33 2 12.46 .002 Low scores 
Other 21 1 4.77 .05 Low scores 
Nonschizophrenics 188 12 7.78 79 
Alcoholism 29 1 0.61 90 
Manica e ; 1168 ‘oot 
anic-di i 5 t ` : High scores 
lepressive 2. A ver 35 
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to the first two hypotheses taken from the 
literature are negative. 

With respect to the third hypothesis our 
findings are positive. From the investigation 
of intelligence of patients by diagnostic groups 
is drawn the conclusion that intelligence can 
be significantly related to diagnosis. Manic- 
depressive psychosis is associated with high 
AGCT score. Schizophrenia, other than para- 
noid and catatonic types, is associated with 
low AGCT score. This is in accord with the 
findings of the sociologic studies of Duval 
(2), Faris and Dunham (3), and Weiss (10), 
who found schizophrenia to have a higher 
incidence in lower socioeconomic groups, 
manic-depressive Psychosis in upper socio- 
economic groups. 

Theoretical speculations to explain the 
findings for different diag: 
interesting to make. 


Summary 

This study involved drawing a 
ple of male, World War II Arm 
from the files of the Veterans pice Thc 
neuropsychiatric hospital at Marion, Indiana 
Army General Classification Test Scores were 
obtained from the Army for 510 cases this 
test having been taken Prior to the onset of 
acute illness. The distributions of Scores for 
this total group and for various diagnostic 
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subgroups were compared to a control a 
tribution based on AGCT data from a 
Fifth Service Command Army inductees. T 
findings were: 

Is No definite relationship was ge 
tween intelligence, as measured by AG we 
and maladjustment as the latter was rep 
sented by the total sample. , aa 

2. Within the range of intelligence oe 
pled by this study no particular level ra 
telligence appeared as optimal for psy 
logical adjustment, . ag 

3. Relationships between nae 
measured by AGCT, and diagnostic ¢ ne 
Cation were indicated: (a) Schizophre a 
other than paranoid and catatonic I 
tended to have obtained low AGCT ne i 
(b) Manic-depressive psychotics tende 
have obtained high AGCT scores. 
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The Revalidation of Diagnostic Tests 
for Alcohol Addiction’ 


Donal G. Murphy 


Fordham University ° 


A reyi 
ee ‘ reports extending through ap- 
number oe o years, during which a large 
Plied in a techniques have been ap- 
Correlates m9 p to uncover the personality 
e conclusi alcohol addiction, must lead to 
Meager, ee that results have been most 
o 0 4 such as that of Sutherland, 
Searches ane Tordella (7) dealing with re- 
ally el eg prior to 1950, have gener 
evidence nat that there is little objective 
Sonality ty icating that any particular per- 
Search of Be 45 predisposed to alcoholism. A 
the literature since 1950 has indi- 


Cated n 
field A marked change in the status of this 
ol inquiry. 


The Inductive Approach 


Noti 
the Pe A discouraging results obtained in 
ome oe of standard testing methods, 
em cnet to approached the prob- 
as been ie in such studies, the effort 
reliably iq ade to develop tests which would 
such bees tify alcohol addicts. The results 
Expected s, when properly validated, were 
Which mi to produce data the analysis of 
Psychic ight lead to a clearer picture of the 
substrates underlying this addiction. 


Amo 
n 
ri work or ed in this direction in recent years, 
Stic questi anson (2, 4) in producing two diag- 
ionnaires yielded initial results of con- 


Siderah 

le i 

Psychome interest. Manson’s aim was to clarify by 
tional, atti- 


i trie di nso 
tudinal, a: Foner specific emo 
Which differ behavioral patterns in alcohol addicts 

ed significantly from such patterns among 


1 

Base 
fulfillment En a dissertation submitted in partial 
rdham T _the requirements for the M.A. degree, 
atitude te ersity. The writer wishes to express 
elpful o William C. Bier, S.J., for his advice 
2 Now at criticism. 

Teachers College, Columbia University. 


is gr 


nonalcoholics. His Manson Evaluation (3) was an 
attempt to assess certain personality traits by ques- 
tions relating to habitual feelings, reactions to per- 
sons and situations, goals and aspirations, physical 
states, and emotional trends. In the Alcadd Test 
(5), on the other hand, questions were openly di- 
rected toward elucidation of drinking habits and of 
affective responses to drinking by the subject and 
by others. Both tests were validated on several hun- 
dred alcoholic and nonalcoholic subjects of both 
sexes and the author claimed high validity, reli- 
ability, and predictive power for the two instru- 
ments. Barillas (1) confirmed Manson’s results with 
the Alcadd Test only, administering this test to 200 
male subjects including alcohol addicts, social drink- 
ers and abstainers, and finding that it did reliably 
differentiate members of the three groups. 


The purpose of the present research (6) 
was the revalidation of both tests, making 
use of female subjects who met carefully de- 


fined and applied criteria. 


Method 


While this revalidation might have been 
attempted using only “alcoholic” and “non- 
alcoholic” classifications of subjects, it was 
apparent that results of possibly greater sig- 


nificance might be obtained if specific groups 
postulated continuum running 


lying along a 
f alcohol to plainly excessive 


from no use 0 
use thereof could be tested. A differentiation 
between active 


within the alcoholic group 
addicts and members of Alcoholics Anony- 
mous suggested itself, and it further appeared 
that there might be significant differences be- 
tween women who customarily use alcoholic 
beverages and those who rarely or never do 
so. Four test categories were set up: active 
alcoholics, AA members, social drinkers, and 
abstainers. Since the Manson Ryaluation was 


designed to reflect personality correlates un- 
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302 Donal G. 
derlying the use of alcohol, it was expected 
that the group mean for active alcoholics 
would be highest (most deviant), followed 
by those for AA members, social drinkers, 
and abstainers in that order, 
the Alcadd Test, it was decided that AA 
members would 


a group of professed abstainers. In this case, 
it was expected that means for both alcoholic 
groups would be high, with those for the other 
groups progressively smaller, 


Nge « 
mum of once per month, apo none 


A total of 132 Subjec 
discard of some EE i eae É 
comparable as to age and length f ! i 
subjects made up the test group, i A ‘ti 
alcoholics, 34 AA members, 34 por ha 


owing the 


years; applying F tests, 


given to the 


Alcadd Test bore the notation 


Murphy 


asked to answer this questionnaire on the basis of 
habits before entering AA.” alized 

Most subjects either lived in, or were hospitalize 
in, southwestern Connecticut; a few subjects We 
resident in New York City and a small number 0 
active alcoholics were tested in a state alcohol 
hospital in Hartford, Connecticut. Socioeconomicely, 
the group tested appears to have been a mian 
class one, there being no striking differences = a 
respect noted among the four subgroups. Length a 
continuous sobriety reported by AA members E 
from 6 to 176 months, with a mean length 0 
months and a median of 36 months. 


Results 


Recalling that higher scores indicate gree 
deviation in the cases of both tests used, rm 
results shown in Table 1 appear to conf 
the hypotheses tested in this research. on 

It will be noted that group mean sco E er 
the Manson Evaluation make up a “la A 
of scores” in the order: active alcoholics, in- 
members, social drinkers, abstainers. Q co- 
terest is the fact that scores for active 4 
holics are much higher than those for for 
members, the latter being closer to those ea 
the social-drinker group. It would ag 
that, in terms of whatever dimensions ers 
being measured by this test, AA mem re- 
resemble social drinkers more than they 
semble active alcohol addicts. uch 

Results on the Alcadd Test also show $ 
a “ladder” but with a reversal in than 
members obtained a higher mean score led 
did the active alcoholics. It will be rec? ir 
that AA members were asked to report No 
habits prior to their joining that groups eii 
definite statement can be made—on Prout; 
evidence—as to the reasons for this pt i 
Possible explanations which suggest t 


Table 1 Test 
Means and Standard Deviations of Scores for Four 


Toups, Using The Manson Evaluation 
and The Alcadd Test 


Alcadd 

Manson Test 

Evaluation PEE 

Test Group N ‘Mean SD_ pn 11 

Active alcoholics 24 356 122 zt of 

members 340234 i23 Hg gp 

Social drinkers 34 15.5 74 S3 
bstainers 28 10.3 6.2 ie 


. (SE ee ee 


Diagnostic Tests for Alcohol Addiction 


Table 2 


The Manson Evaluation and The Alcadd Test: 
t Ratios of Differences Between 
Four Group Means 


Manson Alcadd 

Comparison . Evaluation Test 

ate alcoholics vs. AA members 4.61 5.48 
eae alcoholics vs. social drinkers 8.88 8.26 
ive alcoholics vs. abstainers 10.48 10.57 
members ys. social drinkers 3.16 18.57 
Sate vs. abstainers 5.05 21.13 
ial drinkers vs. abstainers 2.88 5.88 


N 


ote. —F s i 
of 1 ot:—For degrees of freedom involved in these ratios, value 


“1 ranged from 2.65 to 2.68. 


Te include the following: (@) the higher 
ory o may reflect a more accurate mem- 
ose Aberrant, abits than was possible for 
there Closer in time to excessive drinking, (b) 
‚e might have been a tendency by the 
mad maximize difficulties considered as 
Tent while the active addicts minimized 
ings patterns involving strong guilt feel- 
, and (c) the drinking patterns of the 
T mbers in the test group may actually 
tive open more deviant than those of the ac- 
g coholics tested. 
no significance of the differences be- 
e Man means on both tests is indicated 
t will ratios given in Table 2. ; 
Signific be noted that all critical ratios are 
enin ae well above the 1 per cent level. 
results ninations tend to be more marked in 
ctiminat, n the Alcadd Test, designed to dis- 
Ose ae among specific habit patterns, than 
tempts n the Manson Evaluation, which at- 
ality aa surement of less explicit person- 
iffere imensions. Despite the quantitative 
Kat a between results on the two tests, 
i findings appear to establish the va- 


idity of p 
ot i these 
Samples, h, at least with respect to the 


hay 


ene Hoyt’s approximation of the Kuder- 
Were Tdson formula, reliability coefficients 
gees ss at .92 in the case of the 
stance n Evaluation and at .97 in the m- 
are al of the Alcadd Test. These coefficients 
the ae identical to those established by 
Specti St author, which were .94 and .96, Te- 
ively. It would thus appear that, tested 
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by the method of rational equivalence, both 
instruments are highly reliable. 

Pearson product-moment correlation coeffi- 
cients were derived from the scores of each 
group on both tests. Correlations were not 
significant except in the case of the active 
alcoholic group, for which the correlation 
amounted to + .50, significant at the 5 per 
cent level. It would appear that the two tests 
measure essentially dissimilar dimensions, the 
coincidence of which is explicit only in the 
case of the addicts tested. 

A further inquiry into the results obtained 
concerned the predictive power of each test. 
In the present study, the effectiveness of these 
instruments is shown in Table 3. 

Using the cutoff scores suggested by the 
test author, it is apparent that both tests are 
quite effective in predicting status, with the 
single exception that in this case the Manson 
Evaluation did not effectively identify alco- 
holics who are AA members. As noted above, 
the subjects in this group had a high average 
length of sobriety (46 months) and their 
mean test score on the Manson Evaluation 
was closer to the mean of the social drinkers 
than to that of the active alcoholics. 


Discussion 


Results of this research appear to confirm 
the validity and reliability of both tests used, 
as applied to female samples. Predictive pow- 
ers established were in line with those claimed 
by the author, except that women AA mem- 


bers’ status was not determined by use of the 


Table 3 


Predictive Powers of The Manson Evaluation and The 
Alcadd Test: Number and Percentage of 
Subjects in Four Test Groups 


Correctly Identified 
Manson Alcadd 
Evaluation Test 
Test Group N No. % No. % 
Active alcoholics 24 20 80 20 80 
AA members 34 14 41 34 100 
Social drinkers 34 ao 91 32 94 
Abstainers 28 27 96 28 100 
Total 120 % M 114 95 
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Manson Evaluation. Recalling that—in terms 
of the dimensions measured by that test— 
these AA members resembled the social drink- 


clinical deviants” 
As to the Alcadd Test, it is a 


o item and factor an 

i al 
point the way to a more effecti 
standing of alcoho] addiction 


Donal G. M: urphy 


Summary 


This report details results of t 
which two questionnaires—the Manson Eval 3 
ation and the Alcadd Test—were used in a 
ing 120 female subjects making up four pe 
8roups: active alcoholics, AA ger ony a 
cial drinkers, and abstainers, While the M T 
son Evaluation did not effectively Te 
the AA members in the test sample, all A 
results appear to confirm the clinical = by 
reliability, and predictive power claime 
the author for both instruments. 


Received September 20, 1955. 
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A Comparison of the Bender-Gestalt Test and the 
Digit-Span Test as Measures of Recall’ 


Alexander Tolor * 
USAF Hospital, Parks Air Force Base, California 


This 
mestina eee study was designed to in- 
rain lessee ability of patients with organic 
'Sorders to snr patients with psychogenic 
est designs se digits and Bender-Gestalt 
Psychologists inical experience has led some 
Peating di it to conclude that difficulty in re- 
ects an s forward or backward often re- 
retention ean defect (2, 10). However, the 
Vulnerable. digits also seems to be highly 
May ay the effects of anxiety which 
ae a oo impaired concentration 
te, that a rh , 10). It would seem, there- 
Span for di disproportionately short memory 
igits could be ascribed to organic 


Mpaji 
rmen fi 
dary an or to impairment which is sec- 
fe an emotional disturbance. 
e 


Ben 

ry asa renal Test has only recently been 
tal Ship betwe re of memory for designs. The rela- 
ined and mi the number of Bender figures Te- 
ie Subjecteg psychological variables has not 
iter ver, era to extensive investigation as yet. 
watts keee = a few pertinent studies in the 
Boy groups of ee Anderson (6) in comparing 
Fere of control jects having brain lesions with a 
meets SIKEN subjects found no significant dif- 
Sh res recalled eee of the groups as to number of 
Ce of an obj obetz (4) assumed that, in the ab- 
ien e great n stimulus, emotional blocking 
fewe and that Aaa neurotic than for normal sub- 
by ii signs. Thi e former would therefore recall 
is data, is hypothesis failed to be supported 


Th 
. Here ar, 
digit and B a number of differences between 
ated to raner recall some of which are re- 
i e nature of the task, the method 
È opini 
Pinions and conclusions expressed do not 


Nece 
.CSsarj 

Ai rily re 

orce present those of the Department of the 


2 he . 
S dat: 
te Psycholo were collected while the author was 
-Pres T at Neurological Institute, Colum- 
an Medical Center, New York City. 


of administration, and the type of response 
required. One of the most important differ- 
ences pertains to the innocuous appearance of 
the Bender material and to the lesser social 
interaction between examiner and subject on 
the Bender test as compared to the Digit- 
Span test. The over-all effect is probably one 
of a more neutral emotional atmosphere dur- 
ing the presentation of Bender figures than 
during the presentation of digits. 


Procedure 


All patients were tested individually at the 
Neurological Institute of Columbia-Presby- 
terian Medical Center in accordance with 
the clinical procedures regularly employed by 
the staff of the Psychology Department. 


ption of the vocabulary subtest, the 
Bellevue Scale, Form 1, was ad- 
The Bender-Gestalt Test was 
d by Bender (3). Following the 
the designs were removed 
atient was requested to re- 
on a new sheet of paper as 
he could. When the patient 


seemed to have completed the task he was also asked 
to reproduce any parts of the designs that he could 

recall. Only one such additional urging was given. 
Both whole and part figures were counted in com- 
puting the total number of Bender designs recalled. 
The figures which were reproduced from memory 
were also evaluated by the examiner for degree of 
distortion. 
The Digit-Span subtest of the Wechsler-Bellevue 
Scale provided the data on total number of digits 
the number of digits recalled for- 


retained and on 
ward and backward. The difference between the 
Digit-Span weighted score and the patient’s average 


Wechsler weighted score was also recorded to the 
nearest whole number. 

All patients were tested prior to the determina- 
tion of final diagnoses by members of the medical 
staff. The majority of the patients had been referred 


With the exce 
whole Wechsler- 
ministered routinely. 
presented as suggeste! 
copying of the figures, 
from sight and each p: 
produce from memory 
many of the designs as 
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Fig. 1. Comparison of average number of Bender 
figures recalled by organic, functional, „and convul- 
sive patients at different levels of intelligence, 


because their- Symptoms suggested the Possibility of 


an organic brain disease, On the basis of their dis- 
charge diagnoses, th i 


brain tumors, 16 with vascular pathologies, 4 with 
infectious diseases, 15 with head 

degenerative diseases, 
erative disorders, Thes 
and arbitrary and we 
of conveying some id 
were represented, 


e classificatio 


The Psychogenic group contained 49 patients. Be. 
cause of the unreliability of specific lagnostic cate 
gories no further nosological differentia: 


tempted, How 
Patients Were dj 


gy. us, th: 
tion included only pati ith idi 
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Table 1 
Composition of the Three Groups 


Group 
nic 
Organic Convulsive Pan 
Item (V=91)  (N=35) 
` 23 
Male 57 1 i 2 
Female 34 d 
: 1 
Tange 12-72 AN 35.4 
Mean 44.1 27. m 
SD 15.1 11.9 7 
7 79-1 
peri 1g 54-129 61-121 1108 
Mean 90.8 EA 131 
SD 16.7 i 


Jn 
Jevel. 
differences are significant at the a 10 be 
intelligence, the differences in th groups 
tween the organic and psychog sychogeni 
and between the convulsive ane o F, 
groups are significant at the . do not diffe 
organic and convulsive groups tioning. 
Significantly in intellectual att correlatio 

A significant and substantia of memory 
exists between the two i of correld 
as is indicated by the coefficien digit rec 
tion of .43 (o = .06) between combined: 
and Bender recall for all groups 


Bender Recall 


eit 
moge” 
No significant departure from BET o 
was obtained by Cochran’s a This ea 
use of analysis-of-variance design. en 


B 
r of 
nique shows that the mean numbe: 


Table 2 
Analysis of Covariance 


chor 
ic, PIS of 
anic, F to 
(Significance of differences Seal oll ; Gae 
genic, and convulsive groups in Ben: e of covaria 
intelligence Partialled out by analysis 


«ance 
Source of Varia 


eo? 
Item Total Within = 
-~ BOR 
Fe Mee Sum of Squares stor ile a 
Finna Mean Squares = 2.136 


“00! 
= 24.16)? & 
Note.—F for adjusted Mean Squares = 24.16; 
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figures recalled in the three groups differs to a 
significant degree (F = 44.38; p= < 001). 
Since the two groups of patients with intra- 
cranial abnormalities scored consistently lower 
m intelligence than those without brain dam- 
age, it was necessary to control for the effects 
of intelligence in determining whether the re- 
call of Bender figures is a function of clinical 
category. Table 2 shows that in adjusting 
Sa the effects of intelligence by analysis of 
variance a high degree of significance is 
Maintained. 
igure 1 compares the average number of 
itella designs recalled at different levels of 
citer en for the three groups. It will be 
recall ao the organic patients consistently 
genic ewer Bender designs than the psycho- 
tient, Patients and that the convulsive pa- 
sitio generally occupy an intermediate po- 
n irrespective of IQ range. 


i 


Table 3 
Average Number of Bender Designs Recalled 
Group Uncorrected Corrected 
canals 3.48 3.69 
ina nga 5.06 5.15 
Sychogenic 5.98 5.53 
T . 
ete average number of Bender designs Te- 
and fi a each of the three groups prior to 
intellin lowing adjustment for the effects of 
igence are shown in Table 3. 


ous Be relative difficulty in recall of the vari- 
Spection designs can be ascertained by in- 
oe of Fig. 2, A chi square computed by 
Which on’s (11) ranking method is 22.71, 
the ae a p of < .004, indicating that 
«7, terence between the relative frequencies 
high h the various designs are recalled is 
there. ;.uenificant. Figure 2 also shows that 
Broup IS a high degree of similarity among 
Speci in the relative frequency of recall of 
figurati Bender designs. For example, Con- 
ult o S 4, 3, and A tend to be most diffi- 
Signs a subjects in all groups whereas De- 
h and 6 tend to be easiest. 
the ate the three groups are compared for 
ende mber of patients who produce severe 
tions r design distortions and minor distor- 
on recall, highly significant differences 
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` Table 4 


Frequency of Bender Distortions in 
the Three Groups 


Psycho- 
Organic Convulsive genic 
Distortion (V=88)* (V=35) (V=49) 
Severe 33 3 7 
Minor 55 32 42 


* Three patients failed to recall any Bender figures and were 
therefore omitted in this analysis. 


are found (x* = 14.76, $p = < .001). Table 4 
contains data indicating that the relative fre- 
quency of major distortions on recall is far 
greater in the organic group than in the other 


groups. 


Digits Recalled 

Since Cochran’s test confirmed the assump- 
tion of equal variance, an analysis-of-vari- 
ance technique could be applied to the data 
on the total number of digits recalled by the 
subjects in each of the three groups. The F of 
20.17 yields a highly significant $ of < .001. 
Table 5 illustrates that when the effects of 
intelligence are controlled for by analysis of 
covariance the adjusted means still differ sig- 


nificantly. 


mesana FUNCTIONAL 
ese CONVULSIVE 
ORGANIG A 


1.00 
90 
80 
.70 
60 


Pore 


PROPORTION OF GROUP 


3.4 5 6 7 8 


BENDER FIGURES 


Fig. 2. Proportion of subjects in each of the groups 
recalling the different Bender designs. 
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Table 5 
Analysis of Covariance 


(Significance of differences among organic, convul- 
sive, and psychogenic groups in total number of digits 
recalled: effect of intelligence partialled out by analysis 
of covariance.) 


Source of Variance 
re 


Item Total Within Between 
Correlation -70 63 94 
df forr 173 171 1 
bzy value -108 101 — 
Adjusted Sum of Squares 696.38 656.94 39.44 
df 173 171 2 
Adjusted Mean Squares — 3.84 19.72 


Note.—F for adjusted Mean Squares = 5.13; p S 01. 


Table 6 
Average Number of Digits Recalled 


Digit Recall i ive PYcho- 
igit Rec Organic Convulsive ra 
Total 
Uncorrected 9.43 10. 
Corrected 10.07 ee 12.20 
Forward ae 
Uncorrected 5.66 6.37 
Corrected 5.94 6.49 
Backward e37 
Uncorrected 3.77 4.60 5.2 
Corrected 4.12 4.76 TE 
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and — .37, respectively. The data show that 
the convulsive patient tends to do approxi- 
mately as well on the Digit-Span subtest as 
on the other Wechsler subtests. The navel 
genic patient tends to have some degree 0 
impairment in rote memory for digits whereas 
the organic patient demonstrates greatest im- 
Pairment relative to his functioning in ahe 
areas. The difference between the organic an 
convulsive groups is significant at better than 
the .01 level, the difference between the = 
ganic and functional groups is significant a 
the .05 level, but the difference between t : 
convulsive and functional groups is not sta 
tistically significant. 


Discussion 


The results of this study indicate that ther 
is a higher correlation between ore 
digits recalled and intelligence (7 = .70) t re- 
between the number of Bender figures the 
called and intelligence (r = .50). When n 
digit-recall results are analyzed further, 2 
finds a .60 correlation between intelligence T 
digits forward and a .65 correlation beni 
intelligence and digits reversed. These =| 51 
lations are somewhat higher than the 7 0t’ 
between intelligence and the Digit-Spa” 
reported by Wechsler (10). the 

Although there is general agreement 0” bet 
Correlation between intelligence and et 
of digits recalled, there are some oft 
tory findings in the literature on the rela call. 
ship between intelligence and Bender raine 
Aaronson, Nelson, and Holt (1) obt ey- 
an 7 of .03 between MA on the Ship of 
Hartford and Bender recall, and an ihe 
— -10 between CQ and Bender recall. O? 
other hand, Peek and Olson (8) in ae 
Product-moment correlation of .34 bet ed, 
CQ and number of Bender designs rect ey” 
and a correlation of 19 between the SWP ae 
Hartford and number of Bender cee in” 
tained. The present study would seem © its 
dicate that a substantial relationshiP endet 
between intellectual functioning and 
recall, one which is, however, less at 
relationship between intellectual functi? 
and digit recall. ri” 

The data indicate also that the Bender of 
call is superior to digit recall as a meas" oh 
discrimination between organicity a” 


Path 


> 


NEO 
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piemicity. However, with neither test are the 
ifferences among groups sufficiently large to 


_ Permit prediction in individual cases. 


hee fact that the difference in recall be- 
* n the organic and functional groups 1s 
greater on the Bender test than on the Digit- 
ee seems to support the impression 
eits a ender is less susceptible to the ef- 
It is: anxiety than the Digit-Span test. 
oh ike interesting that the results obtained 
ender io atiu diffculty in recall of various 
reported esigns differ somewhat from those 
studies aA Goodstein et al. (5). In both 
ifficult ea 3 and 4 were found most 
and 6 % ut the ease with which Figures 8 
our Sera recalled by the patients in all of 
of the fen was at variance with the results 
jects ae, er study, Furthermore, the sub- 
E Arst in the present study did not find 
three designs to be particularly easy. 
= contrary, considerable difficulty was 
i eee in reproducing Design A. These 
in subject. could be attributed to differences 
Menta] e used or to differences in experi- 
me recipes Inasmuch as there 1S 
iffer jeer (9) that the various designs 
Useful to symbolic significance, it might be 
relation saenake an investigation of the 
Ship between design difficulty and the 


emotion 
N ic value which the designs have for 


encoy 


Summary 


atien n Jens 
t ts having organic brain disease, idio- 


Were egy ZUes, and psychogenic disorders 
igit-s pared for their performance on the 
Test, Pan test and on the Bender-Gestalt 
Significant results indicated that there are 
asures differences among groups on both 
ENces hol be immediate recall. These differ- 
for the even when adjustments are made 
the ps effects of intelligence. In Bender recall 
Stoy; Ychogenic group does best, the organic 
Brou ried least well, whereas the convulsive 
Ccupies an intermediate position. On 
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the Digit-Span test the order of recall is con- 
vulsive group, psychogenic group, and organic 
group, with the latter retaining the fewest 
digits. The differences among groups are more 
pronounced on the Bender test than on the 
Digit-Span test. The level of difficulty of in- 
dividual Bender designs was also determined. 
Some of the results were discussed in terms 
of the differential susceptibility of the meas- 
ures of recall to the effects of anxiety. 


Received September 20, 1955. 
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The Relation of the MMPI to the Edwards Personal 
Preference Schedule on a College 
Counseling Center Sample’ 


Reed M. Merrill 
University of Utah 


and Louise B. Heathers 


University of Washington 


The Minnesota Multiphasic Personality In- 
ventory (MMPI) is a well-known test instru- 
ment which is frequently used in counseling 
college students 
data are based on a 
Most of the scales 


The new test is the Edwards Personal 


Preference Schedule PPS). It i 
forced-choice iena. Prr i 


matched 


clearly 


as well as the disad- 


vantages of an ipsative scale. 
The needs measured by the Pps are those 
indicated in the manual (4) which gives Eq. 
1 Based, in part, on a Paper presented 


vention of the American Psychological 
San Francisco, California, 1955, 


at the con- 
Association, 


PS 
wards’ description of the variables. The B 
sets out to measure the needs den iure 
Murray (14) and uses similar aoma i 
in titling the needs. Test items Were o tasi in 
chosen for the scales on an a Pesos) Wt 
Consultation with other psychologists. of re 
To obtain an estimate of the ee ru 
lationship present between these two puted: 
ments tetrachoric correlations were sf et 5 
The sample of subjects was dichotom p 
close to the median score of the gr tomie 
possible. The most diverse of the oe p 
was one of 44 per cent of the amn od (8) 
per cent of the sample. Gohsen’s me Sinc? 
of estimating tetrachoric rs was use Pears” 
tetrachoric rs are less reliable ana e rela 
rs, Pearson rs were computed borne e by 
tionship between two variables as Bs nt. TH 
the 7, appeared very highly significa 
Pearson 7s were somewhat lower oe pang 
but the level of significance was no or te 
Correlations were computed not Piz of 
Standard validating and clinical scales ° Jes 


ged 


MMPI, but also for ten experimenta out’ 
derived from the MMPI. These iatus S 
Dominance, Responsibility, and Sta ion (3): 
(7, 8, 9), Drake’s Social-Introver®” any 
Navran’s Dependence (15), Taylor 17)! 
fest Anxiety (16), Winne’s Neuroticn™ 4 0% 

Ook and Medley’s Pharasaic-Virtue 4 oc 
tility scales (2), and an unpublishe m? 
Desirability scale constructed from e 
items by Edwards (4). jjable Pr, 

The sample consisted of all avai a wr 


) a 
Sumably valid records of males seen tional i 
versity counseling center for Lge ai pe 
educational advisement who had tal 
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| the MMPI and PPS during the same coun- 
seling contact. Following Hathaway and 
Meehl’s suggestion (11), records with L = 10 

or F= 16, or Q > 30 were eliminated (4 Ss). 

In addition, since F — K scores of 21 or more 

are most frequent in selection situations where 
Persons are deliberately attempting to make 
Sood impressions (12), records where F — K 

was = 21 were eliminated (6 Ss). One other 
Criterion for inclusion in the sample was used. 

On the PPS there are 15 item pairs which are 
€xact duplicates; the number of agreements 

on these 15 items is used as a measure of 
€ consistency of response. Edwards suggests 
at with a consistency score of 8 or less the 
ot Scores are highly suspect. Six per cent 
tig male normative sample obtained con- 
cis Scores of 8 or less. To find a similar 
Taide Point on the MMPI, a 10 per cent 
Wer om sample of 1,500 male MMPI records 
MMP Cored on the 16 duplicate items of the 
the — For these 150 records 5 per cent of 
ess S obtained consistency scores of 12 or 
ie ga records were eliminated where 
wher S consistency score was 8 or less or 
Was oe derived MMPI consistency score 
or less (12 Ss). Of the original 177 


a 


(82.6 per cent) and noncollege clients. The 
most typical client was a single, 23-year-old 
college sophomore. 

Table 1 shows the means of the sample in 
the standard T scores of the usual MMPI 
scales and of the PPS. T score means are not 
shown for the experimental MMPI scales 
since such scores are not available on all of 
these scales and since, where they are avail- 
able, they are based on quite different popu- 
lations. Table 1 shows that persons who come 
to a counseling center for educational or vo- 
cational counseling differ considerably from 
the respective normative samples, which is to 
be expected. Also, as one would expect, devia- 
tions from the normative group are more 
marked on the MMPI where the normative 
population is a general adult sample than on 
the PPS where the normative population is 
a college sample. This finding is consistent 
with other studies (6) of the MMPI which 
have indicated that college students in gen- 
eral differ from the MMPI normative group. 
On the PPS the counseling client deviates 
most markedly from the normative college 
males on three scales: they rate themselves 
especially low on the heterosexuality scale, 


,  qailable records, 155 remained. These in- especially high on the achievement and en- 
cluded veterans and nonveterans, college durance scales. These differences are interest- 
? 
Table 1 


Client Score Distributions on the PP 


S and MMPI (N = 155) 


Experimental MMPI 


PPS MMPI 
sen ee 
al Mean o iag Scale Mean o fa Scale Mean o 
D 15 334 195 50 Dom 16.87 3.55 
De ito me - P 470 297 55 Resp azn 3.53 
S 11.23 447 52 K 1505 452 55 Status 2258 3.59 
A 13.60 3.78 49 F-K —1038 630 — Si 2704 10.14 
i Ag J501 410 si Hs 435 364 49 Dy 2B w 
T 14.13 4.24 48 Hs+K 1212 347 52 Man. Ans, 1578 798 
Sus 16.22 499 50 D 2022 518 58 Neur 5. i 
Don 1027 4.50 48 Hy 2048 458 56 Pv 16.62 7.68 
a Aba 1705 5.0449 Pad 1702 513 58 Ho 1762 768 
j me BIO s3 s Pdt+K 2306 4.94 60 Soc. Des. 30.79 5.63 
Ch 1336 468s 48 Mf 2708 5.20 63 
En, 1588 437 51 Pa 927 289 53 
He B7 S7 53 Pt 1348 810 54 
> A 1545 5.84 45 PiK 2858 59% 62 
SB 1209 484 48 Sc 1234 788 53 
l SceK 2746 638 59 
i Ma i715 388 57 
MetK 2014 379 58 


ET 
s r" 
are approximations. 
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ing and are developed in other research (13) 
but here our concern is with a comparison of 
the two tests. 
ae 2 presents the tetrachoric correla- 
S between the MMPI and the PPS scales. 
dete z the correlations found are not sta- 
a ly significant. However, more signifi- 
woul Pia were obtained than one 
CA expect by chance alone. In addition, 
Tied, the technique suggested by Brožek and 
es ma tai probabilities of the compound 
ina a obtaining 7 significant critical ratios 
iii ee of N tests of significance was com- 
So th se critical ratio obtained was 16.33 
fina _the number of significant relationships 
is far beyond chance expectations. 
rection o significant correlations exist, the di- 
Clinical of the relationship makes sense with 
Tesear ee ee developed from MMPI 
Dositiy f For example, Change correlates 
negati ely with Ma; Aggression correlates 
Sct ely with Z and K, positively with non- 
tively ected Pd; Abasement correlates posi- 
ith Pa F, negatively with K, positively 
Scales on-K-corrected Pt and Sc. Three PPS 
e usual of particular interest in relation to 
Ost cle MMPI clinical scales. Abasement 1S 
e IY related to the clinical scales. On 
are a hand, Deference and Dominance 
Clients ersely related to the clinical scales. 
feelings wig rate their guilt and inadequacy 
likely y relatively high on the PPS are most 
MPO be abnormal as measured by the 
ay lients who have accepted either a 
Sllower 1 Strong role or a more conforming, 
e Bes e in interpersonal relationships on 
Measured tend to be least like deviants as 
Scales, h by the MMPI. Most of the PPS 
the MMe n show little relationship with 
he PI clinical scales. 
on effect of the K correction of the MMPI 
Selors Correlations is of interest. College coun- 
Scores ave sometimes felt that K-corrected 
SF co] underestimated the adjustment level 
ten i students since, in general, they 
this Poa obtain high K scores. To 4 degree 
po on probably still holds when a 
applie a developed from abnormal groupe 
Btoups; to the responses of fairly norma 
*Ppear’ nonetheless, the K-corrected scores 
latter of value in using the MMPI with the 
Correct pops since the K scale does tend to 
for test-taking attitudes. 


dom: 


Correc 
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On the PPS the social desirability stereo- 
type of the items is partially controlled so 
that it is less easy to respond only in terms 
of culturally approved responses. The K cor- 
rection tends to have the same effect on the 
MMPI scales as indicated by the correla- 
tional data of this study. Of the nine 7s sig- 
nificant at the 5 per cent level when MMPI 
scales are not K corrected, only one remains 
significant at the 5 per cent level when the K 
correction is applied; of the nine 7s signifi- 
cant at the 1 per cent level, two remain sig- 
nificant at the 1 per cent level when the K 
correction is applied, three drop to the 5 per 
cent level of significance, and the remaining 
four become nonsignificant. Thus a partial 
control of the biasing effects of the cultural 
stereotype of normal behavior on the MMPI 
clinical scales reduces the relationship be- 
tween the MMPI and the PPS. 

The results of the correlation of the PPS 
with the MMPI experimental scales are quite 
striking. The significant correlations are again 
generally consistent with clinical expectations 
but relatively low. The two Dominance and 
Hostility scales correlate positively but to a 
lesser degree than one might expect. Respon- 
sibility correlates negatively with Aggression, 
but the expected negative correlations with 
Autonomy and Change are too low to be sig- 
nificant. Attitudes characteristic of persons 
scoring high on the Status scale are directly 
related to Dominance and inversely related to 
Succorance and Abasement. These findings 
are consistent with our usual cultural ess oo 

Of general interest is the consistency of a 
direction of the correlations of the os 
experimental scales with the PPS. if the > 
cial Desirability, Status, Responsibility, an 
Dominance scales are viewed as measuring 
socially approved or “healthy behavior and 
the remaining scales are viewed as measuring 
socially disapproved or “sick behavior. Of 
the PPS scales, Dominance, which is prob- 
ably most closely related to a normal MMPI 
profile, has positive relationships with the 
“healthy” MMPI experimental scales and 
negative correlations with the “sick” scales. 
Of the PPS scales, Abasement, which is most 
closely related to an abnormal MMPI profile, 
has the opposite relationship—negative rela- 
tionships with the “healthy” scales and posi- 
tive relationships with the “sick” scales. Ex- 
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hibition and Aggression show similar inverse 
patterns where the correlations reach a sig- 
nificant level. It is noteworthy that the at- 
tempt by the PPS to rule out the social de- 
sirability preference value of an item is not 
entirely successful; four of the correlations 
between the Social Desirability scale based on 
the MMPI and PPS variables are signifi- 
cantly above zero. 

The pool of Ss was too small to obtain sta- 
tistically reliable differences on MMPI scales 
between Ss with varying profiles on the PPS, 
However, some observations on such profiles 
appear pertinent. A pattern that occurs rather 
frequently is one with Deference and Endur- 
ance high and Autonomy and Aggression low 
or vice versa. Those with the high Aggres- 
sion-Autonomy pattern tend to give a much 
more deviant MMPI profile than those with 
a high Deference-Endurance profile. The Ag- 
gression-Autonomy group ten a 
the “healthy” 
on the “sick” 


those with 


In summary, thi 
scales of the PPS 
lege counseling center : 
The relative atas of e eA ke s = 
views them on the PPS may or ma ars j g 
dicate the presence of personality : eee 
formation as defined by the MME. a 
finding is not surprising in view of the a 
that the PPS is an ipsative scale which a 
not reflect the absolute level of need and the 
fact that psychiatric diagnoses, crucial to a 
construction of the MMPI, are often related 
more to the manner of Satisfying need than 
to the nature of the needs themselves. How- 
ever, where relationships are found they tend 
to be consistent with MMPI research data, 


and the MMP 


Reed M. Merrill and Louise B. Heathers 


Both tests will probably be found useful in 
college counseling centers. Just as the Allport 
Study of Values contributes something unique 
when used in combination with the Strong 
Vocational Interest Blank, so does the PPS 
make a contribution distinct from that of the 
MMPI. The PPS shows the relative weight 4 
person gives to various personal needs and 
the MMPI the degree of response similarity 
to well-defined clinical groups. 
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Douglas T. Kenny 


University of British Columbia 


ser ey fruitful and commonly ac- 
at ai hypothesis is the formulation 
conceptio ey between an individuaľ’s 
indicative n his real self and ideal self is 
chotherap of maladjustment and that as psy- 
the two ot i the discrepancy between 
investigatio ves should decrease. The present 
necessity = was undertaken to highlight the 
able in hen controlling an important vari- 
Namely the valid testing of this hypothesis, 
i = eis of social desirability. 
Teal self mail a discrepancy index between 
Bical pro ideal self two similar methodo- 
Ployeq, o ben have been commonly em- 
an AINE E (2) consists in having 
Sonality ‘ait rate a number of dynamic per- 
under ei s on, say, a 7-point rating scale 
Son ig et ae ional conditions. The per- 
real self a oe to rate his conception of his 
'S ideal nd secondly to rate his notion of 
Provided e The discrepancy measure is 
ences ind the absolute sum of the differ- 
Teal-self en the pairs of trait items on the 
cedure for a am ratings. Another pro- 
orenaney hee Te an operational index of 
Th thi has been through Q technique 
tou s method, the individual sorts a 
e iiie of statements or traits into suc- 
frequenc E that follow a quasi-normal 
instructed istribution, That is, the person is 
Statement to place a specified number of 
inuum p the different categories on a 
Scriptive om most descriptive to least de- 
Orts, a. he individual performs two Q 
Th ‘oe Teal-self sort and an ideal-self sort. 
Provi ap ion between these two Q sorts 
Eii e index of discrepancy. The lower 
Dresente article represents a modification of a paper 


San oed att ; : rare 
an Francisco. q A aa Psychological Association, 


Siven 
Cessiy, 


the correlation is, presumably, the greater 
the maladjustment. g j 

Edwards and Horst (4) have hypothesized 
on the basis of Edwards’ finding that social 
desirability correlates highly with the prob- 
ability of endorsement of personality ques- 
tionnaire items, that the social desirability 
factor should operate in Q sorts. That is 
statements which are socially desirable should 
be judged by individuals as most character- 
istic of themselves. By an extension of their 
hypothesis, it may be postulated that social 
desirability would enter also as an obtrusive 
variable into the rating scale procedure to 
real-ideal self discrepancies. In fact, it is not 
unreasonable to suppose that some of the dis- 
crepant findings between various studies in 
this area may have occurred as a partial or 
direct result of the failure to control for this 
variable. For instance, while the studies of 
Bills (1) and Roberts (6) have offered some 
positive support for the hypothesis that a 
discrepancy between real self and ideal self 
is indicative of personality disturbance, Zim- 
mer’s (8) investigation yielded negative re- 
sults. However, the latter study would be 
open to criticism if it were shown that the 
personality traits employed were “loaded” 
with the social desirability variable. It is one 
of the purposes of this study to show that 
such was the case. 

A secondary purpose of the present investi- 
gation is to determine whether or not social 
desirability enters to the same extent into 
personality questionnaire items, rating scale 
items, and items in Q sorts. There was the 
initial expectancy that social desirability 
would play a differential role in the three 
personality-evaluation techniques. The ra- 
tionale for this expectancy was simply that 


315 


316 


indivi censor their self-descrip- 
oe peso extent in the more highly 
aes techniques than in the less struc- 
frei ones. The order of structure, from most 
to least, would seem to be from the ee 
naire items, to the rating scales, and then to 
the Q sorts. 


Method 


Social desirability ratings. Twenty-five self 
concepts, used by Zimmer (8), were scaled 
for their social desirability ona 7-point scale 
by 67 undergraduate university students (28 
females and 39 males). Zimmer’s criteria for 
these traits were that they must (a) occur 
between six to ten times in one million words, 
as judged by the Thorndike-Lorge word 
count; (b) reflect dynamic content; and (c) 
not represent “a cultural stereotype of a de- 
sirable or undesirable trait” (8, p. 447). No 
explicit reference was made as to how the 
latter two criteria were assessed, 


The instructions to the judges were to rate 
each trait on a continu 


orderly, refined, ambitious, 


precise, determined, 
» economical, ardent, persistent, de- 
, Cautious, conventional, leisurely, dar- 
ing, sentimental, emotional, wary, 


1 wards’ study (3), the 
proportion of subjects stating that each trait 


was characteristic of themselves 
puted, and these proportions sery 
self-endorsement values for the 
traits. 

Rating scale descriptions. A third inde- 
pendent sample of 58 university students (28 
females and 30 males) rated themselves on 


Was com- 
ed as the 
respective 


Douglas T. Kenny 


Table 1 


ionnaire 
Social-Desirability Correlates on Question: 
and Rating Scales 


al 
Question- Real B 
Variable naire Self a 
+ 81** a 
Social Desirability 82** 8 3 
Real Self 
*p <.01. 


ce for 
the 25 traits, once for real self mi on 447), 
ideal self. As in Zimmer’s study ( ie ve 
the real-self scale went from “7. I a not & 
+++ person” to “J. I am ee wen 
+ +. person,” and the ideal-self sc | per 
from “7, I would like to be a very t to be ê 
son” to “1, I definitely don’t wan sures 0 
+ +. person.” For the respective re ratin: 
real self and ideal self, the eae prob- 
scale value for each item v pga ; 
ability of endorsement value. , nden 
Q sorts. A fourth and small inae aliy 
sample of eight university studen d three 
divided between the sexes, pertam rst sorte’ 
Sorts on the traits, The traits were thirdly r 
for real self, then ideal self, o arrang 
how the subjects thought itie trait gjrabilit 
themselves in terms of social xo F 
The following quasi-normal fro paracte" 
tribution was used: From 0 (least ie 
istic) to 6 (most characteristic) 4, p 
steps required frequencies of 2, 3, 4 A 
and 2, respectively. , desirable a 
While it is usually considered tes f 
have a larger number of caie sori 
larger sample of trait statements P the "0 
the main interest was to ere Ot be 
Sible operation of social desirabi dy er $ 
Sorts and not in conducting a Q stu 


sira 
correlation of .82 between . 
and Probability of endorsement co cort 
wards’ (3) original finding of a 


re aa auaa 


—- 
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Influence of Social Desirability on Self Ratings 


k Hd between probability of endorsement 
need —— items based on Murray’s 
Pasties 1$ social-desirability scale values. 
sults, ro anley (5) has obtained similar re- 
Detve A tri correlations of .89 and .81 
of endor esirability rating and probability 
fom i ek a random sample of items 
spectively, and D scales of the MMPI, re- 
ee 1 indicates also that the social-de- 
and ideal variable intrudes into the real-self 
nitude ce rating scales to a similar mag- 
i eect it does into questionnaire items. 
ers of apie of .63 between the rank or- 
doubtedly e real self and ideal self is un- 
sirability aoe reflection of social de- 
Port for th “ts the results indicate no sup- 
Plays a dig ypothesis that social desirability 
ality-evaly erential role in these two person- 
items em i techniques, at least for the 
i ai oyed in this study. 
oe existing between the vari- 
Presented s are given in Table 2. The values 
ability ander the real self vs. social desir- 
Ween once the correlations be- 
Social-desir maival real-self sort and his 
Widual’s ability sort and between each in- 
Of the gy self sort and the redistribution 
Values of az median social-desirability 
Used in th e traits to fit the forced intervals 
ideal self 1e Q sorts. A similar analysis, for 
of Table o expressed in the last two columns 
desirability The correlations between social 
tts are t and the real-self and ideal-self 
ighlighted in this table. Thus the 


T Table 2 
ndividual Q-Sort Relationships 


Sub. pe Real Self vs. Ideal Self vs. 
Jeet 5 Social Social 
bee Tiei Desirability Desirability 
i Self Own Group Own Group 
3 a gre  41** a6  46** 
een 01 .47** ‘o 4 
= = a ee do 
S a ooi ee 
6 AE, 60** 4g ss**  .68** 
7 52** ` E “poke 
Hate 29 26 Si, o2 
rnis i72 065+ 83 69%" 
ii 64** — (33* 71** .38* 


Table 3 
Composite Q-Sort Relationships 


Real Ideal 

Self Self 
Social Desirability 166 Soe* 
Real Self 32% 
** p <01. 


data support the Edwards and Horst (4) 
formulation that social desirability should 
enter in Q sorts. It is of some interest to 
note that the real self and ideal self correlate 
significantly with the independent group con- 
ception of social desirability in every case 
but two. 7 

To assess the influence of social desirability 
on the Q sorts taken as a whole, the eight 
scores for each trait item were averaged to 
form an averaged score value. On the basis 
of their averaged score values, the 25 traits 
were redistributed into the categories of the 
quasi-normal frequency distribution. This pro- 
cedure was followed separately for the real- 
self, ideal-self and social-desirability sorts. 
Table 3 reports the intercorrelations between 
these averaged self-assessments. Again the 
operation of social desirability on Q sorts is 
confirmed. 

Discussion 


A major implication of the present findings 
is that social desirability operates in a sig- 
nificant fashion in all three personality-evalu- 
ation techniques. No evidence was found to 
support the initial expectancy that social de- 
sirability would play a differential role in 
the three procedures. 

The results also have practical implica- 
tions for investigators who test the twofold 
clinical hypothesis that maladjustment is in- 
dicated by a discrepancy between real self 
and ideal self and that the correlation be- 
tween the two selves should decrease as ther- 
apy proceeds. Unless the social-desirability 
variable is controlled, the specific variance 
in the difference score between real self and 
ideal self will be negligible because social de- 
sirability will cancel out any reliable differ- 
ence between the two selves. That is, the 
“inflated” correlation between real self and 
ideal self has an important influence on the 
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specific and error variance measured by any 
computed discrepancy (difference) score. The 
net effect of a high correlation between the 
two selves is to reduce specific variance and 
to increase error variance in the discrepancy 
score. Hence, it would be fruitless to investi- 
gate whether or not a discrepancy index is 
related to personality maladjustment if social 
desirability produced a high correlation be- 
tween real self and ideal self. Furthermore, 
the error variance in the difference score will 
be large if the respective reliabilities of the 
real-self and ideal-self measures are low. 

It is obvious that the specific variance of 
the discrepancy score may be increased by 
having a large number of traits rated and by 
controlling the influence of the social-desir- 
ability variable. The former procedure has, 
of course, its exceptions. But, how might one 
control for the latter variable? For struc- 
tured Q samples, Edwards 


cause the present findings indicat, 
traits are “loaded” with social 
stereotypic responses to them 
occurred in Zimmer’s study. As a 
personal involvement may have 


e that these 
desirability, 
undoubtedly 
result, little 
entered into 
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his subjects’ judgments. In short, unequivocal 
evidence against the discrepancy hpo 
requires rigorous control over the social- 
sirability variable. 


Summary he 
This study was designed to indicate bei 
necessity for controlling the eT ae 
ity factor in testing the twofold clinica 
pothesis regarding discrepancy gs iar tive 
self and ideal self and to assess the re ality 
influence of social desirability on mana 
questionnaires, rating scales, and Q ore! e- 
findings support the conclusion that eet 
Sirability enters into the three oO re- 
techniques to about the same extent. nclu- 
sults further suggest that Zimmer s = an 
sion that discrepancies between real i ope? 
ideal self are not indicative of conflict is tro 
to question because of his failure to CO 
for the social-desirability factor. 1 of 5% 
It was emphasized that the contro ad 
cial desirability is an indispensable asp thesis 
any study testing the clinical hypo dures 
about real-ideal self discrepancy. Pa iisorep" 
for increasing the specific variance of social 
ancy indices and for controlling the 
desirability variable were discussed. 
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The Evaluation of the Significance of Differences 
Between Scaled Scores on the WAIS: 
The Perpetuation of a Fallacy 


H. Gwynne Jones 


Institute of Psychiatry (Maudsley Hospital), University of London 


Th 
i = WAIS manual, Wechsler claims that 
ferences i two-thirds of the observed dif- 
Not excep yo scores on any two tests do 
ences as larg ree scaled score points. Differ- 
ough to se as five points may be unusual 
Should he p e noteworthy; smaller differences 
fore Jess like cognized as more common, there- 
makin a to be significant” (3, p. 18). 
e clinical is statement Wechsler is inviting 
clude that Psychologist using the test to con- 
icative Ss discrepancies, being rare, are 
ommon, Ja pathology, a practice already 
arlier de as a result of Wechsler’s 
this order or (2). In fact, differences of 
Even in the . magnitude are very common, 
ent from yy adardization sample, as is evi- 
ea Vechsler’s own argument. 
tests in re S5 possible pairings for the eleven 
"espondin © scale. Wechsler examined the cor- 
the 25. 55 distributions of differences for 
Value of ri group, found that the median 
nan deviations was approxi- 
above ae deduced the proposition 
SD Points ag 1s choice of a difference of 
fo Value of i critical level represents an 
Bane ee, 1.7 and, there- 
t centage dea at the 9 per cent level. This 
sue tion Sf S not, however, refer to the 
an a discre individual subjects displaying 
te erences E ei but to the proportion of 
i h which 55 occur for each sub- 
n ti co at on Wechsler’s reasoning, some 
re A discrepancies of this magnitude 
Wechs] expected in any one record. 
ADE j the statement is, of course, more 
StWeen q 1s concerned, not with a difference 
ny two tests, but with a difference 


eref 


between two specified tests as such specific 
pairings occur only once in each record. Such 
usage, however, is only justified when there 
are prior grounds for selecting the specific 
difference examined. Thus, for example, if it 
is predicted on independent grounds that a 
certain subject will achieve an abnormally 
low score on Block Designs as compared to 
Vocabulary then Wechsler’s method may be 
applied though, of course, the direction of 
the difference is then of importance and a 
one-tailed test may be applied. In such cir- 
cumstances, however, it would be unwise to 
make use of Wechsler’s approximate average 
standard deviation as, owing to the wide 
range of correlation between different tests, 
the magnitude of the standard deviation 
varies considerably. Thus, for example, the 
correlation of .81 between Vocabulary and In- 
formation yields a standard deviation of dif- 
ferences below two scaled score points while 
the correlation of .30 between Object As- 
sembly and Digit Span raises the value to 
over 3.5. 

As the writer has only recently received 
the WAIS test material, empirical data de- 
rived from that test cannot be quoted in sup- 
port of the arguments advanced in this paper. 
Similar reasoning can, however, be applied to 
test results derived from the earlier Wechsler- 
Bellevue Scale (2). The scaled scores of 32 
Kansas Highway Patrolmen, rated as well 
adjusted, are reported by Rapaport (1, p 

i x P 
521). If examined for subtest discrepancies 
these data show at least one difference of it 
least five scaled score points for all but one 
subject. In all 32 records there are 251 dif- 
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ferences of this magnitude, representing some 
14 per cent of the 1,760 differences involved. 
Sixty-one differences, or 3.5 per cent of the 
total, are of seven or more scaled score points, 
and eight differences reach ten points or more. 
When the 110 possible specific, directional 
discrepancies are examined, 56 of these fail 
to reach six scaled score points in any record. 
Of the 54 which achieve this magnitude or 
greater, 17 occur once, 19 twice, 7 three 
times, 7 four times, and 4 five times. 
Wechsler promises to discuss fully the rela- 
tion of his findings concerning subtest differ- 
ences to problems of patterning in a forth- 
coming book. It is to be hoped that he will 
clarify the issues discussed in this paper. If 
the wide range of random scatter found in 
normal protocols were fully realized much of 
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the effort now expended in research on ee 
ter analysis would be more fruitfully appii 
Though group patterns may be establishe a 
the range of individual deviations will a. 
great as to render the procedure ee Fe 
individual application by clinical psych? 
gists. 
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Edward 
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llen L. Edwards Personal Preference 


Schedul 
le (PPS). N 
1953, ae S). New York: Psychological Corp., 


Reviewed by 


J. Richard Wittenborn 
Rutgers University 


n 
The p, 
erso. 
Constructed os Preference Schedule, a thoughtfully 
m contemp rument, embodies merits expressive 
Phasizes the psychology. Although the author 
t value of his schedule as an instru- 


Meni fi 
Or rese 7 
| Prove to p ‘arch, it comprises features which may 
0 
4 


3.0 
* Order, 
Ve > 4. Exhibit; 
Ab, Tiiratention om 5. Autonomy, 6. Affiliation, 
an tsement, ti E Succorance, 9. Dominance, 10. 
€, 14, Heter, urturance, 72. Change, 13. Endur- 
A ibe Scores mt and 15. Aggression. The 
i indicates i from a procedure whereby the 
2 aits of ey is preference in each of a series of 
re SC pairs ae Xperiences, activities, or situations. 
eve, tements ovia by a matching of each of 
Y other ee <p of one of the needs) with 
> degptited was tea selection of the statements to 
h, viability of the ed by consideration of the social 
to 8 the thant statements. It was hoped that 
of ial deslrakil of the pairs equal with respect 
ility would reduce the probability 


cial g, Ced score p 
Alp ability, S being confounded with their so- 


Ough th 
e pai ; 
Ument paired-comparison structure of this 


duc ma; 
i the effec Control social desirability and re- 
A tages and h 


intens be ; 

thene? A eee disliked and, in addition, the 
fest mes Possi eed may remain obscured. It is 
4 

A 


tiong 


IEWS 


and the retest correlations range from .74 to .88 with 
a median 78. = provided for both men and 
women college stu i 
scores as well =" Erai ye te puted 
me ats . e 1509 cases 
comprising the standardizing group were drawn from 
many different colleges broadly representative of geo- 
graphical areas and types of institutions. 

An interesting feature of the PPS is the fact that 
it yields scores which are relatively independent de- 
spite the fact that they are relatively reliable. The 
highest subtest intercorrelation, 46, is between Nur- 
turance and Affiliation, certainly no more of a rela- 
tionship than would be anticipated from the simi- 
larity of the constructs represented. These two 
variables, possibly with a third variable, Abasement 
seem to bear a small but systematic, negative rela. 
tionship with such variables as achievement, au- 
and dominance. These and other possible 
may be inferred among the in- 
lausible and do not detract from 
one’s confidence that the variables may be usefully 
expressive of the need achievement system from 
which they draw their labels. 

The Personal Preference Sc 
strument in the particular respects that it is de- 
signed to measure personality constructs which have 
a conceptual origin independent of the instrument 
itself; the subtests are not only reliable but rela- 
tively independent so that they are free from a con- 
fusing and uneconomical overlapping implication; 
and there is a built-in estimate of the reliability of 
the individual’s performance jn the form of a self- 
consistency score. The user also enjoys substantial 
protection from the possibility that the manifest 
need scores could be confounded to an important 
degree by the need to appear socially desirable. The 
possibility of personality schedule scores being con- 
founded with a tendency to present a socially desir- 
able facade is often considered to be a fatal defect 
among such instruments. Edwards not only mini- 
mizes this possibility by pairing the statements on 
the basis of their predetermined social desirability, 
but he scrupulously examines the degree to which 
he has succeeded in doing this by the use of other 
scales and inventories. Incidentally, it is possibly the 
pisma = the eee with social desir- 
ability whic! permits the relativ i 
lations between the scales. itey lowe anteteonies 

hen one thinks idi A 
Mae one Teie Sei of an Sistrumenik 
e degree to which its 


tonomy, 
consistencies which 
tercorrelations are p 


hedule is a modern in- 
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lated to some explicit, practical cri- 
tanon for oe definite sample. Such relationships, 
however, are but an expression of a possible conse- 
quence of validity; they are not the basis for va- 
lidity. A certain type of empirical validity may be 
relatively easy to show for most aptitude or achieve- 
ment tests. Most such tests comprise a set of items 
or performances which is in effect a sample from 
a hypothetical population of Performances, and the 
sample of performances comprising the criterion may 
also be conceived as drawn from the same hypotheti- 
cal population of performances. This “sampling” ap- 
proach, which characterizes most of our testing ef- 
a reliable test 
rion sample of 
ity to be dem- 
Id not be con- 
- The Personal 
rovide a reli- 
ng the rela- 
and previ- 
It would be 
between the 
by the Pps 
» OF manifesta- 
Nevertheless, it 
the author to 


on the need system, 


The erence scales haye been corre- 
lated with other scal — 
sults do not 
scales do distinguish p 


indefinable, conglomer: 
empirically valid for 
useful behavior. 

At the present time this ri 
aspects of the total proced 
some immediate attention, 
geneity or heterogeneity o 
to the intercorrelations am 
has not been examined ; 
Second, the answer sheet, 


eviewer finds only two 
ure which may require 
First, the relative homo- 
f the scales with respect 
ong their component items 
this could be important, 
although faultlessly de- 
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+ zing the 
is a little tedious for the person „who is E 
test. From the standpoint of scoring and ser a 
tion, it would be very difficult indeed to oe "The 
a more convenient and agreeable proce role on 
schedule is virtually self-scoring and the Peet 
the reverse of the answer sheet is self-in 


| 
i sults, 
signed for the rapid scoring and collating of results | 


rence 
Edwards, Allen L. Edwards a ae 
Schedule (PPS). New York: Psycholog 
1953, 1954. 


Reviewed by 
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pedulty 
In developing the Personal Preference Schee 4 


r ujck 2 
Edwards was seeking “, .. to provide rativelY w 
convenient measures of a number of 5 ” Furthet 
dependent normal personality pma primati 
the instrument was intended to be vse i ectives k i 
in counseling and in research. Both ope has be } 
highly desirable. Far too little ogee nf th 
paid to the development of measures rele 
normal range of behavior. . 

The 15 da of the PPS oatensl wee ants 
manifest needs proposed by Murray. ae which he 
ditional score, a measure of jerome aie r 
developed to provide information n to i 
subject’s test-taking behavior. In addi Edwar pe | 
plications to counseling and research, for classt0 
gests that the schedule will be useful a in ut A 
demonstrations, in selection sa ie these Pee f 
verted factor analysis. If its uselulneSS be a Sii $ 
poses can be demonstrated, the PPS wi mentari” f 
cant addition to the psychologist’s arma: plicati? m 

The coincidence of the dates of Praal RC i 
this instrument and of the APA’s Techni Diag" gs 
mendations for Psychological Tests and T 
Techniques suggested a preliminary me jn deve ail 
sessing its adherence to good practice ntainine je- 
ment. A check list was developed ee pot! vet 
items in the APA pamphlet which were pip W 
vant to this kind of instrument an s then © 
marked essential. The test manual wa iii 
Pared with these points, and a decision the cot 
as to whether the PPS conformed ie it id fae? 
recommendations. In 54 out of 60 ae n the 
form, giving it a “score” of 90 per cen ple sig” orf 
of it, this would seem to be a favora wl : 
fortunately, the “score” did not tell g 
The percentage of “hits” varied from i 
mendations regarding administration 
lidity. ide 

The major sections of the manual Pragion pn of 
ful framework for discussion, The Sè i T m 
velopment is given over largely to 2 effects cgn 
the method followed for reducing me BE a ipo 
SPonses of the factor of social desirabi which i 
is cited later, in the section on ante ad ul. 
cates that this attempt was largely SU! 
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ing from the section on development is information 
as to the sources of items and the methods of item 
oe The reader is told that each of Murray’s 
ey As paired with each other twice, yielding a 
lise T 225 items. It would be interesting to know 
Dir e items were selected and built. : 
aber ge for scoring and administration are fairly 
Fears and straightforward. The PPS is untimed and 
college pests 40 minutes’ working time for most 
qüite Lee, oe it was built. It is not 
small, S ~administering, but chances for error seem 
aan te is simple and can be done by clerks. 
is there hen the omission of items requires prorating 
is small et likelihood of difficulty, and this hazard 
Profile Saree scores may be easily plotted on a 
also available. T scores; percentile equivalents are 
Nea based on 1509 cases—760 men, 749 
Colleges, N students drawn from a number of arts 
ditions shee information is given regarding the con- 
oe der which the students took the PPS. 
e eT mean difference of 1.69 years between 
OF the se ae favor of the men but separate norms 
Sers = are provided. 
emselves ae PPS are advised to determine for 
Sirot he limits for high and low scores. Ed- 
of 70 ang as tentative cutting points with T scores 
the tin being high, 30 and below being low, 
s Sii iate points being 10-point T-score ranges. 
test-ta) in loned, the validity check or measure of 
Score, a g attitude is provided by the consistency 
the num Measure “, |. based on a comparison of 
the same er of identical choices made in two sets of 
that the ag items” (Manual, p. 6). Edwards shows 
from distribution of consistency scores departs 


cludes at based on the expanded binomial and con- 
Score 4 it is effective. He suggests a consistency 
tioning the less be considered grounds for ques- 
Evidence e subject’s test-taking attitude. Further 
cients of n the same problem is based on coeffi- 
hese exe Profile stability. Ninety-three per cent of 

ceeded chance in the standardization group. 


Wo le 
“Oefficien ‘inds of reliability estimates are provided: 


stabilie of internal consistency (split-half), and 
After cor Y (test-retest). The former are reported 
the nej ee by the Spearman-Brown formula; 
Stabj ity rected coefficients are not reported. The 
niversity ancients are based on a sample of 89 
> gro of Washington students, a surprisingly 
tween Be, for such a purpose. The interval be- 
Soe cient: S was one week. The internal consistency 
Heterosex, sange from .60 for Deference to .87 for 
74 Nuality ; the stability coefficients range from 
as hi Chievement to .88 for Abasement, certainly 
hethor EA those reported for most similar tests. 
be in ne should be higher is a question im- 
ea: reliability theory as it applies to person- 
fulne S Te There is a question about the use- 
terva] of stability coefficients based on a week’s 
clude r ia 1s to be hoped that further work will in- 
Subjects, Ber time intervals and a larger sample of 
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Intercorrelations among the 15 scales are presented. 
Of the 105 entries, 96 are statistically significant. 
The majority are negative. The highest intercorrela- 
tion reported is .46; most are less than .20. It would 
appear that, by and large, Edwards had succeeded 
in producing an instrument with relatively independ- 
ent scales. Since construct validity is involved, a 
factor analysis would certainly seem to be a requisite 
next step. It should have been done and reported 
in the manual. 

For all tests, validity is the ultimate question. 
Here the PPS is most deficient, at least insofar as it 
is possible to tell from the published manual. A list 
of research projects in process is included, but, in 
the absence of information about the results ob- 
tained, this list is of limited interest. Unless satis- 
factory validity can be demonstrated, all other fea- 
tures of a test tend to be meaningless. 

The APA Technical Recommendations describes 
four kinds of validity: content validity, predictive 
validity, concurrent validity, and construct validity. 
The PPS manual deals only with the last of these. 
As indicated above, Edwards was seeking to develop 
measures for the needs described by Murray. It 
would seem necessary, therefore, that he demon- 
strate that his scales do in fact measure these needs. 
No such evidence is presented. 

Admittedly, construct validity is difficult to estab- 
lish but the difficulty in no way reduces the neces- 
sity for establishing it. The recommended approaches 
to. construct validation are contained in the APA 
pamphlet as follows: 

“Essentially, in studies of construct validity, we 
are validating the theory underlying the test. The 
validation procedure involves two steps. First, the 
investigator inquires: From this theory, what pre- 
dictions would we make regarding variations of 
scores from person to person oF occasion to occa- 
sion? Second, he gathers data to confirm these pre- 
dictions” (Technical Recommendations, p. 14). It is 
also suggested that factor analysis is one method for 
establishing construct validity. o g 

One part of the section on validity contains re- 
ports of studies based on self-ratings by subjects. 
Although correlational situations are implied, results 
are presented verbally as follows: “The self-rankings 
of some subjects agreed perfectly with their rank- 
ings on the PPS” (p. 13). Unless one paid proper 
attention to the word “some,” he could infer a rho 
of 1.0. What he might conclude after noting the use 
of the word “some” remains in doubt. Edwards con- 
cludes this section of the manual with the following 
statement: “It is not clear, however, how even per- 
fect agreement between self-rating and inventory 
scores could be interpreted as bearing upon the na- 
ture of the variable being measured by the inven- 
tory” (p. 13). In view of the lack of clarity, the 
omission of this section might have been desirable. 

The principal line of validation rests on correlating 
PPS scores with scores on the Guilford-Martin and 
the Taylor Manifest Anxiety Scale. The Cooperative- 
ness, Agreeableness, and Objectivity scales of the 
former were used, based on a total of 106 cases. 
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With the Guilford-Martin, the PPS scales correlated 
significantly in 4 cases with Cooperativeness, 11 
cases with Agreeableness, and 2 cases with Objec- 
tivity. There were only 2 significant correlations 
with the Taylor. One conclusion which might be 
drawn from the above is that the PPS measures 
Agreeableness or lack thereof. 

The comments above suggest a dilemma. Either 
Edwards has based his claims for the validity of the 
PPS on construct validity or on some other kind. 
Since the manual contains nothing to support claims 
of any other kind of validity, we must consider his 
efforts in regard to construct validity. He has cor- 
related his scales with four others, drawn from the 
Guilford-Martin and the Taylor. The significant cor- 
relations are not interpreted to bear on the construct 
validity of the PPS. That is to say, no reasons are 
given to support the notion that the PPS does in 
fact measure the manifest needs proposed by Mur- 
ray. It would seem, therefore, that the only conclu- 
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sion to be drawn is that no usable information is 
presented regarding the validity of the PPS. p 

It is the responsibility of the test author and the 
test publisher to establish the validity of any wing 
strument made available commercially for use m 
one or several practical situations. In the case of this 
instrument, both the author and the publisher seem 
to have fallen short of meeting their responsibilities 
in this respect. One single, simple step might have 
been—and still might be—taken to correct this. 
Across the front of cach test and cach manual, there 
should be stamped, in large, red letters (preferably 
letters which will glow in the stygian darkness of the 
Personality measurement field) the word EXPERI- 
MENTAL. 2 

It is experimental. It is an intriguing, prone 
in many ways very carefully conducted experiment, 
but it is still an experiment. Until its validity has 
been established, it must remain an experiment, aN 
it should not be released for any other purpose. 
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Whe 
Place “he! not behavioral change can take 
in the ce with procedures instituted 
lef. Belief hological clinic is a matter of be- 
ture of hs. a subjective matter and the na- 
Seems to va evidence required to achieve it 
aborigines ae from person to person. Thus, 
teve that a ave been found who do not be- 
ehavior relationship exists between sexual 
male, Ss pregnancy in the human fe- 
can Since, foe of statistical significance 
acts do i them of this relationship. The 
See fit into their theoretical frame- 
Who beliey r culture, there are individuals 
e does ate that a person behaves the way 
because Ra he is possessed of the devil,” 
meant to be some supernatural reason, he 
Tame of jee that way.” Persons with such 
© nature erence will not be convinced by 
ehavioral S available evidence bearing on 
More n in clinical subjects. Other 
Statistica] sticated persons reject evidence on 
q” harper implying that no one has 
jects is a at behavioral change in clinic sub- 
are, of co result of clinical procedures. They 
it in hate correct. No one has “proved” 
evidence fone The best available published 
Rly ore gtk this matter is that re- 
M which b forth by Rogers and Dymond (4) 
able is ] chavioral change as a criterion vari- 
ence, ar aly neglected. Satisfactory evi- 
exist, ne na grounds, does not now 
Out the out an established criterion, with- 
Moka Py of efficient controls, it is 
Mi e that a rigorous scientific experi- 
a at this 
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Evidence, however, does exist. Belief in it 
will depend on the frame of referen 
individual. Certain biases can be “ee ee 
; gled out 
which seem to be related to the accept: 
of the evidence available. One is a ae R 
that the human organism learns. This Nets 
one to which all of us will give lip Has 
lip service because, although we believe in the 
learning of reading, writing, and arithmetic 
we do not, many of us, believe that other 
habits such as attitudes can be learned. An- 
other one seems to be the conviction that hu- 
man learning can be controlled, that is, that 
conditions can be set up which will foster or 
hinder the learning of specific pieces of be- 
havior. A third might be the belief that the 
human organism has the capacity to react 
with what it has learned in one situation to 
another similar situation. With these beliefs, 
one is in a fair way to accept the evidence 
bearing on pehavioral change in clinical sub- 
jects as a result of or concomitant with cer- 
tain procedures in the clinical laboratory. The 
available evidence runs somewhat as follows: 
A subject is brought, or comes under his 
own power, to our clinical laboratory. It is 
determined, on grounds not relevant here, 
that the purpose of laboratory procedures is 
to obtain a decrement in the number of hours 
the subject spends alone. Whereas the sub- 
ject now spends, on the average, 2 total of 
ten out of seventeen waking hours alone, it is 
desired that he spend, on the average, less 
than five hours a one. Number of hours 


day al 
spent alone becomes our dependent variable. 
From a § 


tudy of the subject’s past history 
and whatever we can Jearn from psychological 
tests, We formulate hypotheses concerning the 
intervening variables related to the depend- 
ent variable. Since we cannot observe oF 


change hours spent alone outside the labora- 
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tory, we need to change behavior in the labo- 
ratory that is highly correlated with our de- 
pendent variable. 


ent, gross, dependent variable 
care for her infant i 
again obtain 


satisfy Us, .01, .001 


by the D 
Psychology for training So €partment of 


poses in connection with the 
chology Training Program, Itt 
of children and adults from agen 
cians, the school Systems and h 
mention some of the referral g 
Service Center takes all 
or treatment which are fe 
province of a clinical psyc. 
an outpatient setting, 
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The Service Center has been in operation 
in its present form since 1951. During that 
time there have accumulated 1,022 case files. 
The files were entered with the aid of a 
table of random numbers. Prior to entering 
the files, however, certain rules for selection 
Were set up. All cases were used which met 
the following criteria: (a) any case which 
was terminated by consent of both therapist 
and patient, (b) any case of long-term, 
“deep” therapy which was in progress or was 
interrupted, where the patient was seen in F 
least one hundred interviews (called Type a 
therapy), (c) any case of supportive brie 
therapy which Was in progress or was vee 
Tupted, where the patient was seen in at ri 
thirty sessions (called Type II therapy), ( n 
any case where environmental manip oe 
Was the major goal, where the patient ie 
seen in as many as five interviews (ca ce 
Type I therapy). These criteria were ser ri- 
on the basis of considerable previous E 
ence. It was felt that cases which had or 
than the criterion number of interviews sti- 
the type of therapy indicated did not Sane 
tute an experiment, The criteria iceman 
what did or did not constitute an erpe ads 
in this context are outside the range of son- 
discussion but are analogous, in the ce in 
ing behind them, to the criteria ae 
other more systematic experimental ae 
In any Case, these rules were set up ie in 
entering the files. Cases were exclude any 
which large environmental effects bey ae 
Possibility of control by the therapist ‘cases 
fered with therapy. In this manner ten 
were selected from the files. from 

For each case, notation was made, con- 
the case history, of behavior which was nge, 
sidered deviant and it was desired to ae 
as reported either by the patient or ae 
else Who gave the history, the latter nts: 
Often being the case with child Pp nt of 

hereafter, after conclusion or interrup Sa 
therapy, a final summary of the case, vere 
Fess reports, or statements of the patient ror 
used to make a judgment as to ee 
not the behaviors previously noted cha was 
in the predicted direction. No follow-up out 
used, no attempt was made to find be- 
whether or not the patient maintained a d 
havior change over a period of time. We 


w a for the objectivity of this procedure; 
<i cognizant of the possible biases of 
a wrote the case records, of the in- 
ik a underlying the patient’s “good” re- 
eaa c. The reliability of judgments as to 
dicted ie not behavior changed in the pre- 
i dersten a is perfect. This finding is 
iabilit ndable because, disregarding the re- 

ity of the case histories themselves, the 


l 
File 
No. 


322 


355 


155 
402 


| l 
! 
{ 


py 727 


N 69 
A 
l mwg 
3 
S4 


Age 


27 


28 


31 


35 


27 


26 


28 
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Table 1 


First Group of Ten Meeting the Criteria for Selection 
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questions asked of the case records could be 
answered by a simple yes or no. 

Table 1 shows the results obtained, ten hits 
and no misses. Skepticism seems appropriate 
for these data. Therefore we pulled out an- 
other ten cases meeting the criteria for se- 
lection. Table 2 shows the results, eight hits 
and two misses. Although expansion of the 
binomial indicated a satisfactory level of sig- 


Sex 


F 


M 


M 


M 


No. of 
inter- 
views 


Behavior to be changed 


Change 


Predicted 
direction 


194 


50 


70 


34 


13 


102 


135 


214 


41 


. Frequent quarrels 
. No plans for 


. Fainting spells 
. Overweight 


. Fearful, withdrawing behavior 


in school 


. No social contacts with men 
2. No contacts with parents 


. Unable to care for children and 


perform household duties 


. Few social contacts 


. Submissive and passive behav- 


ior, e.g., beaten by younger 
children 


. Frequent accidents 


. Uncontrollable weeping 
. Insomnia 


. Multiple phobias 


. Frequent hostile outbursts 
. No dating 


. Drinking excessively to relieve 


anxiety 


. Somatic symptoms, €-8-, stom- 


ach cramps 


. Frequent prostitutes 


. Infrequent dating , 
2. Ashamed of poor hearing and 


refused to wear a hearing aid 


. Few social contacts 


future and dis- 
satisfied with job 


pe 


. None for 2 years 
. Lost 14 pounds 


. Active participation in school 


activities, improved grades 


. Began dating regularly 
. Began visiting parents 


. Caring for children and doing 


housework consistently 


. Began regular church attend- 


ance 


. Began having fights in school 


and took responsibility for 
younger sibs 


. None while in treatment or im- 


mediately after 


. Ceased completely 
. Sleeping well 


. These subsided almost com- 


pletely 


. Ceased completely 
. Frequent dating 


. Not drunk for 10 months 
. None for one year 
. None for one year 


. More dating 
. Bought hearing aid and used it 


. Began to join clubs, etc. 


. These greatly diminished 
. Entered graduate school with 


plans 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 
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Table 2 
Second Group of Ten Meeting the Criteria for Selection 
No. of 
inter- 
ue Age Sex views Behavior to be changed Change 
380 47 M 10 1. Acute alcoholic episode where 1. Sobered up 
he was continually drunk 
2. Unable to work 2. Working steadily for 2 years 
369 42 M 18 1. Using narcotics 1. None for 14 years 
2. Crying spells 2. None for 2 years 
3. Hypochondriacal complaints 3. None for 2 years 
884 5 M 60 1. Unintelligible speech 1. Now easily understood 
2. Poor coordination (muscular) 2. Better coordination 
3. Not completely toilet trained 3. Toilet training completed 
4. Played with electrical outlets 4. No shocks for 10 months 
and received severe shocks 
384 19 M 162 1 Several attempts at suicide 1. None for 2} years 
2. Crying, tremulousness 2. None for 2} years 
3. Poor grades at college 3. Better grades 
lsi 327 M Bi i Took too much insulin for dia- 1. This corrected 
betes against doctor’s orders 
2. Hypoglycemic attacks 2. None for 3 months 
3. Frequent awakening at night 3. Ceased d 
4. Very frugal 4. Now buys furniture, etc. an 
p takes trips di 
5. Very passive in dealing with 5, Has been able to fire subordi- 
subordinates nates when necessary 
94°32 OM 25 1. Had failed doctoral language 1, Passed language exam and pre- 
exam twice lims later 
2. Verbally threatened violence 2. Stopped 
toward a professor 
85 21 F 48 1. Few close friends 1. No change 
430 29 M 40 1. Overt homosexual acts 1. No homosexual acts for 8 
months 
A Frequented prostitutes 2. None for one year r 
Constant extreme muscular ten- 3. Moderate tension occasionally 
n 
2 3 ; r š 
29; M2521, 4 nitrous oxide and in- 1, Gradual decrease until total 
" ening to Bi 
on tape recorder g ible 2, Ceased 
171 2 M L E i inki 
2. High bhaga E 1. This reduced ae 
* Weakness p, Pressure, somatic 2. Became more severe and 
stomach burning Sensation in pitalization became necessary 


nificance even for this findin 
nevertheless worried by the 
in the two misses obtained. 
other ten folders from the files. Table 3 shows 


3. Hyperactive 


g (.05) we were 
trend indicated 
We selected an- 


. No change 


the results, ten hits and no misses. ae ël 

ing satisfied us. We felt we could sa 

on the side of the “hits.” 
Tables 4 and 5 show all of the cases P 


Predicted 
direction 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


No 
Yes 


Yes 


he find- 


ulled 


arr 


oo the files, 350. It will be noted that the 
ulk of these were diagnostic only. The cate- 
gory “Inquiry Only” exists because any first 
interview conducted at this Center is usually 
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Table 3 


Success or Failure 


Third Group of Ten Meeting the Criteria for Selection 
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written into the files despite the fact that the 
Inquiring person may never return to the 
Center. The second largest category listed in 
the table is that labeled “Too Few Sessions.” 


File 
No. 
405 


895 


14 


385 


616 


67 


110 


226 


179 


325 


No. of 
R 5 inter- i 
ge Sex views Behavior to be ch icted 
z S = ehavior to be changed Change dreu 
1. Failing grades at school 1. Began receivin; i 
eH ig passin, di 
2. Frequent disciplinary problem Zi Marked reduction in murea Yes 
ior 
24 F 5 1. Indecision over impending en- 1. Became engaged Ye 
gagement "e 
2. Dreams and nightmares 2. These ceased 
3. Had broken engagements in 3. Got married 
past and avoided becoming se- 
rious with boys 
29 F 197 1. Suicide attempt 1. No further attempts Yes 
2. Constant sitting on husband’s 2. Ceased 
lap . 
3. Weeping behavior 3. Ceased 
4. Few social contacts 4. Began attending social affairs 
often 
4 M 163 1. No speech 1. No change Yes 
2. No response to others 2. Attempts to communicate by 
pointing 
3. Assumed positions, posturing 3. This done infrequently 
4. Habitually constipated 4. No problem for 6 months 
25 
F 44 1. Few social contacts 1. Joined clubs, etc. Yes 
2. No pleasure in sex relationships 2. Began to achieve orgasm 
3. Fear of driving a car 3. Learned to drive 
3 P 
2? M 93 1, Wife beat him 1. This ceased and at times he Yes 
struck her 
2. Spells of extreme physical weak- 2. None for about 3 years 
ness 
3. Crying spells 3. None for about 3 years 
2 
2? M 25 1. Attacks of nausea and depres- 1. Ceased for about 3} years Yes 
sion 
2. Left school and was indecisive 2. Returned to medical school 
about future 
2 M 65 1. Failing courses at school 1. Improved grades and graduated Yes 
2. Not eating and sleeping well 2. Eating and sleeping well 
32 M 155 1. Worked over-long hours 1. Ceased , Yes 
2. Unable to communicate to wife 2. Easier verbalizations with 
or subordinates at work people 
Z F 77 1. Excessive sleeping A. This ceased Ves, 
2. Exhaustion and nausea often 2. This ceased 
3. Hypnogogic experiences 3. These remained 
4, No dating 4. Got married 
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This category is probably the one that would 
be most suspected in estimating the effects of 
psychotherapy in our presentation. It will be 
noted that there are more cases in this cate- 
gory than the thirty that were accepted for 
the study. Whether or not these can be con- 
sidered failures in 
for discussion beyond the realm of this paper. 
We feel that the matter is irrelevant to our 
“Environment 
Effect” is broken down and self-explanatory, 
the analysis, 


five children 
and twenty-five adults, Most of the adults 


were in what we call Type II therapy which 
consists of attempts to modify variables 
Type I ther- 


Judgment can 
s made, let alone refined statistical pro 
ce ures applied with unreliable data such as 
Improved” or “unimproved.” Nor have we 
been concerned with whether or not the 
mechanisms of ego-defense became more suit- 
Table 4 
Analysis of Cases Rejected 
Reason for rejection Numb 
er 
Diagnostic only 
Inquiring only i 
Environmental effect a 
Couldn’t pay 5 ? 
Hospitalized 3 
Left town 3 
Withdrawn by physician 1 
Too few interviews to meet criterion 43 
Total cases rejected 320 


G. R. Pascal and Melvin Zax 


Table 5 


Analysis of Cases Retained 


Behavior changed 

Mean in predicted 

No. of direction 
Type of Hours mr ae ae 
therapy Seen Number Yes No 
Type I 10 1 1 A 
Type II 60 16 14 ‘“ 
Type III 184 8 8 0 
Play 71 5 5 r 

Total cases retained 30 


able (3) or if the patient was more momo 
able or optimistic (4) or a host of other EEA 
lar measures proposed to estimate the effec 
of Psychotherapy. 1g eg0- 
By all means let us make the patient's “his 
defenses more suitable. Let us change se d 
attitudes about himself and others. But E 
have no significance if they are not telea 
in the behavior of the patient as it 1S to 
played in the environment in which he Pa or 
live. Making ego-defenses more amabe ee i 
what have you) may be an hypothesis u 
cerning a way to effect behavioral change can 
it cannot be used as a criterion. Neither ae ` 
unvalidated tests and questionnaires (nO ae 
ter how much they are Q-sorted) be sey o- 
criteria. If the ultimate purpose of pe ip 
therapy is to effect behavioral change cri- 4 
it has to be) then behavior must be eer `‘ 
terion. This proposition not only make., psy- 
= t it gets us closer to the science © 
chology, ‘ ek 
The writers are aware that something aa i 
than mere behavioral change is consider cho- 
the problem of success or failure in Par 
therapy. There is, for instance, the ae 
tion of time during which behavioral i an- 
1S maintained after psychotherapy. bape our 
SWer to this question pushes us back nge 
Jstematic formulation. If behavior is ctype 
by simple environmental manipulation havio 
I) then the maintenance of changed beba ge 
will depend on the stability of the A 
environment. If, on the other hand, the 4 ex- 
ess of changed behavior was accomplishe ithin 
clusively by manipulation of variables eat 
the individual (Type III), then the ch 


N 
| 


T= 


eS SS OO OEE a 


_ 
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behavior should be maintained with relative 
freedom from the environment. No thorough- 
8oing study with results of psychotherapy 
Can neglect a consideration of procedure used 
to effect behavioral change if the time di- 
Mension is to be added to the notion of suc- 
cess or failure. Another consideration is that, 
a hough success or failure may be concerned 
with the achievement, in the environment, of 
à desired and predicted change in behavior, 
© question as to what behaviors, and how 
ee they have to be changed, is unknown 
into 1s writing. This consideration leads us 
lean morass known as “psychological 
eid ce We shall by-pass this matter and 
à ei polemic by asserting that we believe 
e aS behavior can be changed in a pre- 
direction by the systematic use of well- 
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established principles known to the science 
of psychology. 
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Relationship of Success and Length in Psychotherapy 


James W. Taylor 


Veterans Administration Hospital, Denver, Colorado 


Fig. 1. Rated Success as a 
terviews indicates that both 
Was necessary in combining 


u; 


function of number of 
the class į 


in 
the graphs, y ; 


the clinic during a fiscal year (309 Cases of 
varying diagnosis and with different thera- 
pists) were evaluated for number Of treat- 
ment interviews and for results of treatment. 
Results of treatment are evaluated as, o un- 
improved, 1 mildly, 2 moderately, and 3 
greatly improved by the therapist and con~, 
sultant. While this criterion for improvement 


leaves much to be desired, such Jogme 
are common in most clinics operating a 
practical restrictions. Figure 1 combines Bs 
data presented by Cartwright in three E ic. 
with the Corresponding data of this ae = 
Representation of the two scales of ae to 
ment on the same figure was not mean 


*———+ CARTWRIGHT 


i 30 in- 
break in the horizontal axis at 


whi 
and 33.5 include the 30th interview (4 cases) 
es the number of 


Patients in each class interval. 


« ose is 
imply their equality; rather, the pi 
to illustrate the similarities of the cu 
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The Representation of Orthopedic Disability in 
Children’s Figure Drawings 


A. B. Silverstein and H. A. Robinson 


Psychiatric Institute, University of Maryland School of Medicine 


T 
frst expe years have passed since Schilder 
Which aa his belief that “the way in 
ects thejr i draw human figures really re- 
of the bod nowledge and sensory experience 
ime Guage eee (14, P: 106). Since that 
observation Filipe have developed this 
a clinical oth at the level of theory and 
variously Ferree Body image has been 
e lack Pe obed by different writers, and 
as undoub a universally accepted definition 
tematic p tedly served as a deterrent to sys- 
'heless een in this problem area. None- 
lief that one has remained a widely held be- 
thing of Hie human figures do reveal some- 
is own bad subject’s conceptual picture of 
Proponent ee Machover, the most active 
e drawine, dynamic interpretations of fig- 
Of drawin has stressed that “the process 
Ject , shops the human figure is for the sub- 
but oe et Problem not only in graphic skill, 
body meget, Projecting himself in all of the 
to be re nings and attitudes that have come 
35) tee in his body image” (10, p- 
ed pk figure drawings are a commonly 
namics ool for investigating personality 
iliar > self concept, and body image; a 
techniqu Part of the clinical battery. This 
Projective however, shares with many other 
e instruments the need for convinc- 


„8 an 
lidity. unequivocal demonstrations of va- 


accept 


The 


r ; > 
Vestigati esent authors are engaged in an mM- 


ti j 
ea iy of psychological factors 1m the 
of and recovery from poliomyelitis,” 


and h 
ure q ave had the opportunity to study fig- 


cert 


LAj Jae: 
for sided r 
or Tage’ bY a grant from the Nafjppalakourdayipn? 


Infant; 
atile Paralysis rain 7 
NAVI NA u bale 


Dated 


Tawi p 
ings of children in various stages of 
Si 


IN 1 COLG 


form of 
“Hea | 
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that illness. In exploratory phases of this 
work we were frequently impressed with what 
appeared to be a rather direct reflection of 
the child’s disability in his drawings, and 
given impetus by these observations, decided 
to initiate a more systematic study of the 
technique. If this procedure could be demon- 
strated to yield a true picture of body image 
it would prove extremely useful, since data 
from other sources than figure drawings have 
shown that the discrepancy between body im- 
age and the actual physical body is related 
to adjustment processes in physical disability 
(2). It should also be noted that figure draw- 
ings as such have received scant attention as 
possible measures of attitudes toward disabil- 
ity. A nonverbal measure of disability-associ- 
ated attitudes and modes of adjustment would 


be of great value to workers who deal with 


the disabled. 
The earliest study of the figure drawings of 


handicapped subjects is reported by Machover 
(10). Her brief account of this investigation 
of 20 orthopedic cases provides no methodo- 
logical details. It would appear that drawings 
were simply scrutinized for the possible pro- 
jection of disturbances of body image, and 
the preliminary results are said to have been 
striking. Other investigators (1, 6, 12, 16) 
have taken a similar approach to drawings 
produced by various types of disabled sub- 
jects, and their results, while not as impres- 
sive as Machover’s, seem to be encouraging. 
Taken together, these studies suggest that, 
while relatively few subjects portray their 
disabilities directly, indirect evidence in the 
distortion and displacement occurs 


$ 
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1. Study of Subjective Classifications 


Method. The writers have used a sorting 
approach in studying a series of drawings by 
disabled children. Same-sex, opposite-sex, and 
self-figure drawings were obtained from a 
group of 22 chronic Poliomyelitis cases with 
paralytic residuals of the lower extremities. 
Each of the three sets of drawings was evalu- 
ated independently by the authors. With no 
Preliminary formulation of a classification 
scheme, and with negligible disagreement þe- 
tween the judges, we found that these draw- 
ings could readily be sorted into six cate. 
gories. The distinguishing features of these 
groupings were: (2) omission of a Portion of 


Fig. 1. Self-figures drawn by four 
A. Self-figure by a ten 
residual weakness of bot! 
B. Drawing by a bo a nine-year. 
restricted to the right aa he i aA Seog 
C. Drawing by a nine-year-old girl 
birthday, she has been readmitted to n 
rective surgery. Severe Paralytic residuals 


ade 4 


e s a si pi 
D. Figure by a ten-year-old girl in Grade E chopp ed” 


— 
disease onset occurred at age 5. Her right Jee Tree 
eg brace with pelvic band. This child has ha i 

h 


3. 


hospital readmissions for corrective surgery, 
mirror-fashion. 


children with ] 
in Gr 


f a spinal poli 
“Brader, 


orthopedic hospital 
oth legs 
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the legs; (ù) external support for the drawn 
figure, e.g., by an orthopedic appliance; (c) 
marked size discrepancy of the legs; (d) im- 
proper attachment of the legs to the trunk; 
and (e) unusual treatment of the upper ex- 
tremities, with the legs judged to be within 
normal limits, The final category (f) in- 
cluded drawings considered to embody neither 
direct nor indirect evidence of disability. 
Results. Four of the 22 self-figures are pre- 
Sented in Fig, 1, Though the drawings differ 
a great deal, each appears to show clearly 
and dramatically some representation of of 
Pairment. In one way or another these ch 1 
dren seem to have projected their physica 
condition upon their drawn figures. Nor are 


Ower extremity disability following poliomy a ed 
© Wears bilateral full-leg braces and has a 


omyelitis at age two, idual is 20W 
Isease onset was at age five. Residual 


t 
i er frs 
Since the poliomyelitis onset before n cor- 
on five occasions for observation a 


z ective 
She wears a long leg brace with cor 


h in 
she has faithfully pictured her brace, thoug 


4 


«foe 
Spt 
els 
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Table 1 


Classification of Figure Drawings by 22 Children 
With Lower Extremity Disability 
Following Poliomyelitis 


Same- Opposite- Self- 


Group ser See ad 
Portion of lower extremities 
` omitted 5 3 : 
‘xternal support provided 0 9 . 
ize discrepancy in lower ex- 
tremities 6 i > 
proper attachment of legs 3 2 
usual treatment of upper 
extremities 4 3 F 
© evidence of disability 4 5 : 
A 22 22 2 


sa Sh ia examples; many of the draw- 
aid direct representation, displacement, 
equal] lon, or other unusual treatment, are 
Y suggestive of body-image disturbance. 
rayne 1 presents the distribution of figure 
een bo among the six categories which have 
divine e. In each of the three sets of 
Subjects” More than three-quarters of the 
Physica] Were judged to have portrayed a 
rectly. py ability, either directly or indi- 
ings sh Y Inspection the three sets of draw- 
Categorie similar distributions among the 
erna] = With the one exception of the “ex- 
three oo classification. In this instance 
Pedic T f-figures were depicted with ortho- 
his Ppliances, and one seated at a desk. 
Might suggest that the most direct rep- 


Tesentar: g c 
fier tion of disability may be found in self- 


A rie 
n additional observation should be made 


Wit 
in hie, ect to a pattern of consistency found 
Part af i drawings. If an individual omits a 


ample, p legs of one of his figures, for ex- 
simi], £ tends to treat the other figures 
two aY. Of the 22 subjects, 16 have either 
Categor three of their drawings in the same 
ro SA whereas by chance this should oc- 

a me 9 or 10 times. This difference from 
level, expectancy is significant at the .0 


of piscussion, While these findings, like those 
Be urs ayestigations cited above, appear very 
pr aging, it is clear that this subjective 

Cach to the study of figure drawings 1S 
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seriously deficient from the point of view of 
scientific rigor. For one thing, the judges who 
evaluate the drawings are not only aware that 
they are dealing with productions of handi- 
capped individuals, but also have some gen- 
eral knowledge of the nature and site of the 
disability. This may introduce bias in at least 
two ways: the observer may tend to over- 
weigh minor deviations as evidence of dis- 
ability, or he may de-emphasize certain char- 
acteristics not obviously related to the known 
impairment. Another difficulty in this method 
of dealing with figure drawings stems from 
the enormous variety of the productions. 
Even when working with small samples, one 
must arbitrarily limit the number of classifi- 
cations to avoid the unmanageable prolifera- 
tion of categories. And this inevitably poses 
the need for an equally arbitrary system of 
priorities, since many drawings will embody 
the characteristics specified in more than one 
category. Drawing A in Fig. 1 illustrates this 
problem: the figure lacks feet, and the legs 
are attached to the body in an unusual way. 
An even stronger objection to this approach 
is that the frequency of occurrence of the 
s drawing features in a comparable 
ormal sample is unknown. To the 
he drawings of clinically normal 
individuals are found to exhibit the same 
characteristics as those of disabled persons, 


the utility of the technique is diminished. 


Taken together, criticisms of this sort seri- 


ously undermine any conclusions which may 
be drawn from studies employing subjective 
classification and appraisal of human figure 
drawings. To be sure, normal controls and 
objective methods have not been entirely neg- 
lected in studying figure drawings of the dis- 
abled. Several investigators (3, 12, 15) have 
compared the drawings of handicapped and 
normal individuals, using checklists of signs 
or physical measurements of _ the drawings. 
Without exception these investigations yielded 
negative results, in the sense that drawings 
of disabled and normal subjects were not re- 
liably distinguished. In each case, however, 
it would appear that flaws in sampling or 
methodology may have had the effect of ob- 
scuring differences in the drawings. In this 
connection the following points deserve men- 
tion: Failure to control for correspondence 


variou 
physically n 
extent that t 
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Table 2 
Comparison of Disabled and Control Subjects with Respect to Age, Intelligence, and Grade 
Age IQ Grade 
SD 
Group Mean SD Mean SD Mean = 
4.7 y 

i = 22) 11.2 1.19 94.6 9.27 0.94 

Soren oF = Fri 11.1 1.02 97.6 7.26 a 
i 0.48 1.40 B s 2.54 
1.39 1a <05 

j >.10 >.10 >.10 >.10 >.10 


between the sex of the subject and that of his 
drawn figure denies, in effect, the possibility 
of differential identification with, and projec- 
tion on, same-sex and opposite-sex figures. In- 


ted that the hetero- 
iduals poses a diff- 


his goal, and at the same time re 
tive to the need for homogeneity, 
jects of the present study can be considered 
homogeneous to this extent: They share the 
same disease entity and the same genera] site 
of disability. They are enrolled in g Public 
school equipped to deal with orthopedically 
disabled children who by reason of their 
handicap cannot attend their regular Classes, 


Main sensj- 
The 22 sub- 


This is an environmental control oi 4 a < 
and also ensures that each nee ae 
marked degree of disability. Age ich child 
Varies greatly in this sample, but eac acute 
was at least a year and a half past the 
Stage of the disease when he was seen. 


2. Controlled Study of Signs 


jects 

Method, Having considered rang is- 
in the light of factors related to t 4 some 
ability, it is now necessary to rep si to de- 
other characteristics of the group, aak were 
scribe a sample of normal subjects w. hildren 
introduced as a control. The disabled equa y 
ranged in age from 9 to 12 and were normal 
divided by sex, Over 100 physically school 
children from the same gry a sub- 
System were tested, and 44 of the com- 
jects were selected to form a pronk ect to 
parable to the disabled sample aithre Patient 
age, grade, and reported intelligence dsa Je 
(Kuhlmann-Anderson). These 44 ee range 
children, equally divided by sex, a aie was 
in age from 9 to 12. The control gr expeti- 
established at twice the size of liability i 
mental sample to increase the relia normal 
comparisons, and because physically roup of 
subjects were easily available. The g on the 
children with poliomyelitis residuals, sabe 
other hand, represents nearly all r of the 
cases. Table 2 presents a compariso. 
two groups. is seen tO 

The equation of the two groups ‘d Sintelli- 
be entirely acceptable for age te signifi- 
Sence and mean grade placement; signi 
cant differences are obtained. arene 
cantly greater variance in grade P ay well 
Observed in the disabled sample Ha school 
reflect differing periods of absence aS re- 
during treatment for poliomyelitis. 


ee 
——— 


N 


A 


Da 


4 
& 


Orthopedic Disability in Children’s Figure Drawings 


Spect to the measures reported, it is sub- 
mitted that the two groups are essentially 
comparable, 
„Each sample was tested in a classroom 
situation during the school day. The conven- 
onal figure-drawing procedure was followed: 
E subjects were instructed to draw a per- 
the’ oT a person of the opposite sex from 
ture, tst. They were then asked to draw pic- 
ah a of themselves. No time limits were set, 
T no further directions were supplied. 
of E analyze the drawings obtained, a list 
35 scoring items or signs was developed. 
zie Rea of the signs deal specifically 
0 lo Ypes of treatment which may be given 
ee r extremities in figure drawings; for 
ont, e, shape of foot, length of leg, and 
sree, tae Six signs call for comparisons be- 
notin di arms and legs of the figures, as in 
etian differences in the use of shading. The 
tion oe twelve signs involve no considera- 
Other fi the legs of the figure, but pertain to 
flect oe which might be expected to re- 
ability. y-image changes resulting from dis- 
acem, such as the size of the figure and its 
ing gj ent on the paper. Most of these scor- 
the ES were taken directly or adapted from 
and Ports of Buck (5), Goodenough (8), 
vised o loyer (10), and the remainder de- 
or ¥ the Present writers. 
to pach sign, specifications were drawn 
Ptelimin e objectivity of scoring, and a 
actori] ary test of the procedure was satis- 
Petiment Completed. The drawings of the ex- 
a ran al and control groups, combined in 
om order, were then scored independ- 
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ently by the authors. Each sign was scored 
plus, minus, or unscorable. As an example, a 
figure with misshapen feet would receive a 
plus score for a particular item; a figure with 
feet judged to be normal would be scored 
minus; and a figure from which the feet had 
been omitted would be considered unscorable 
for this item. Of the 10,890 individual signs 
(55 signs for each of three drawings by 66 
subjects), 88 per cent were scored in agree- 
ment by the two judges. Scoring disagree- 
ments were later resolved in conference. For 
individual signs, the percentage of initial 
agreements ranged from 54 to 98 per cent, 
but for only three items was it less than 80 
per cent. An agreement of 33 per cent would 
be expected by chance. On the whole, the ob- 
tained scoring reliability is considered to be 
acceptable. 

Results. In statistical analysis, the three 
sets of drawings (same-sex, opposite-sex, and 
self-figures) were treated separately. For each 
set, chi square corrected for continuity was 
employed to compare the drawings of the two 
subject groups on the 55 signs. F isher’s 
method (7, p. 96) was used to determine the 
exact probability associated with chi squares 
which approached significance. For each com- 
parison, the null hypothesis was tested against 
the alternative that the disabled group con- 
tained a greater proportion of subjects scor- 
ing plus on a given sign. Table 3 pea a 
summary of the statistically significant dit- 
ferences found among the 165 tested. 

In the 55 comparisons made for each of 
the three sets of drawings, two or three dif- 


Table 3 


Ż Values Exceeding the Five Per Cent Level in 


Comparison of Figure Drawings of 


Disabled and Control Subjects 


(Total number of comparisons for each figure is fifty-five) 
Same-sex Opposite-sex Self-figure 
Item 

EN 1039 
16, eee Placed at side edge of paper 017 
Y Feet , Rie midline (waist area) —_* ws 

. er in size or shi front view, á ‘049 

z. To drawn lighter, e fainter than corresponding arm da 
26, Ta Placed above horizontal midline of paper i eer 
28, Gus, h of leg greater than twice length of trunk ae 
a Width” thinner than the other .039 j 

5 of leg increases toward foot 0002 ois 


` Leg att 
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ferences significant at the .05 level or better 
might be expected on the basis of chance 
alone. It would be necessary to obtain at 
least six such differences to rule out the op- 
eration of chance factors (at the .05 level) 
(13). The number of differences actually 
found to be significant at the .05 level or 
better, for the same-sex, opposite-sex, and 
self-figures, was two, five, and three Tespec- 
tively.* It is accordingly clear that the draw- 
ings of the disabled and normal subjects have 
not been reliably distinguished by the scoring 
system employed. 

Discussion. The results of this objective 
and analytic approach are Plainly less en- 
couraging than those obtained when the 
drawings, as described earlier, were sorted 


it to be a rather 
mpairment, Among 


A 4 : 1S, cl 
1s an example of a finding of a subjective ae 


2? These figures refer only to differen os. 
in the predicted direction. Three differences watt 
were statistically significant in the unpredicteq Ft 
rection—where the control 8roup exceeded the dis- 
abled sample in proportion of plus Scores—are not 
reported in Table 3, 


impressionistic approach which does not stand 
up under more careful scrutiny. 

From the methodological point of view, any 
subjective classification method is clearly in- 
ferior to the objective and analytic sign ap- 
proach. It should, however, be noted that 
this latter method is itself not beyond criti- 
cism. As mentioned earlier, the bulk of signs 
used in this study dealt specifically with types 
of special treatment given to the legs of the 
drawn figures, with the rationale that the pri- 
mary disease residual was in the lower ex- 
tremities of the subjects. Yet it may be that 
restricting the choice of signs in this way has 
unduly de-emphasized other distinctive treat- 
ments, as when the body-image representa- 
tion of the Physical disability generalizes, 0 
is displaced to other portions of the Don 
than the legs. At a somewhat different level, 
the criticism has been offered that “the check- 
list [of Signs] violates that holistic, amani 
cally oriented approach which competent t 
nicians use in making drawing analyses” yi 
rear; Criticisms of this kind seem entirely 
reasonable, and must be taken seriously. It i 
Possible, with the materials of the aap 
study, to utilize a more global, “clinical ae 
proach and at the same time retain a mea 
ure of scientific rigor. 

Clinical indents as to whether oi 
drawings were executed by disabled oF Lan 
mal subjects have been reported in the oe 
ture (3, 15). The findings of these a ade 
have been negative, i.e., the drawings of bly 
mal and disabled groups were not et 
distinguished. However, some of the yx r 
flaws (heterogeneous samples and the in- 
ure to control for sex) found in stae ag 
volving the sign approach may have ups 
Served to obscure differences between sil A 
ìn investigations using clinical judgme the 

he relative homogeneity of subjects 1 tor, 
present study, and control of the sex a 
here Provide a better opportunity for $ 

ifferences to appear. 


3. Controlled Study of Global Judgments 


e 

Method. Each of three judges was give” 7 

three randomized sets of same-sex, OP. pops 

sex, and self-figure drawings, with instructi gs 
to select—py whatever cues the draw” 
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Might provide—the 22 figures in each set 
Which had been produced by the physi- 
cally disabled children. The three judges 
Were postdoctoral clinical psychologists ex- 
perienced in the psychodiagnostic use of fig- 
Hie drawings. Before evaluating the draw- 
— they were given information about the 
a characteristics of the two subject 
TRE (age, sex, and IQ), and about the 
ant characteristics of the chronic polio- 
of di ke children (nature, site, and duration 
iud ‘sability). For an individual figure, the 
a Ses knew only the sex of the child who 
Was ie J the drawing; their task, in effect, 
ings be choose—from 66 drawings—11 draw- 
sider Y boys and 11 by girls which they con- 
ed to be productions of disabled subjects. 
esults and discussion. The choices of each 
t meee judges were first compared with 
ings the others, for the three sets of draw- 
the ude the basis of chance, 56 per cent of 
test Se of any two clinicians would be 
by cha to agree. (Two judges, who agree 
disabled o on one-third of their choices of 
implicit children’s drawings, will also have 
evaluat; agreement on two-thirds of- their 
e eet of figures by normal subjects.) 
judges Percentage of agreements between 
i anged from 52 to 79 per cent for the 
“ie Ssible combinations (three sets of 
Bal Seen by three judges). Four of the 
nt / OOPS yielded better than chance agree- 
tent the 5 level), suggesting that to some ex- 
n Cane ges were using similar cues. 
istinguish oe the ability of the judges to 
and nor : between the drawings of disabled 
lection mal children, 56 per cent of the se- 
rect S might again be expected to be cor- 
ranged ie ance. Correct judgments actually 
Sets o rom 52 to 64 per cent for the nine 
Was mg. tuations. No one set of drawings 
ther a accurately appraised than any 
erg Sad no one judge was superior to the 
drawa o his ability to distinguish among the 
or were any judge’s ratings S18- 
etter than chance. 
experimental findings, like those ob- 
with the sign approach, do little to 
rs the value of the figure-drawing tech- 
ante study of body image in physi- 
Ss} ility, The promise of the original 
Slonistic sorting method has been ful- 


Nificantiy p 
an ese 
ineq 
“thane 
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filled neither by an objective, analytic pro- 
cedure, nor by a controlled holistic approach. 


Discussion and Implications 


A number of hypotheses may be suggested 
to account for the negative results which have 
been reported, though none of these hypothe- 
ses can be tested with the present data. Har- 
ris and Goodenough, on the basis of a large- 
scale investigation of children’s drawings, 
have concluded that it is somewhat doubtful 
whether children actually do project the body 
image upon drawn figures. They remark that 
“so much of the drawing technique in chil- 
dren under 12 or 13 years of age relates to 
concept formation and understanding, that 
probably only a small part of drawing be- 
havior relates to the child’s interest, tempera- 
mental qualities, and other personality fea- 
tures.” ° Since few of the subjects in the 
present study were older than twelve, it may 
be that only a small part of the drawing be- 
havior sampled is related to body image. 

Levy’s exposition of the technique contains 
some pertinent observations. Noting that 
“some clinicians interpret each drawing as a 
projection of the body image” (9, Pe 260), 
he acknowledges that this sort of projection 
does frequently occur. He nonetheless goes 
on to point out that a drawing may also rep- 
resent many other things, €-8., “a projection 
of attitudes toward someone else in the en- 
vironment, a projection of ideal self-image, or 
a result of external circumstances. Levy re- 
marks, moreover, that “it is usually a com- 
bination of all of these.” Little wonder that 
the body image is so difficult to tease out of 
so complex and intricate a production! 

A third possible explanation for the nega- 
tive results stems from an observation by 
Machover, who writes that “a leg or an arm 
may be omitted or distorted for reasons of 
crippling anxieties, just as surely as for the 
physical crippling of those limbs” (11, p. 
263). This is a powerful and compelling ar- 
gument: if psychological and physical factors 
are reflected equally and indistinguishably 
in drawings, any attempt to differentiate the 
drawings of disabled and normal subjects 


3 Harris, D. B., personal communication, January, 
1955. 
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seems doomed to failure, however rigor- 
ously controls are established. Having made 
this attempt with particular and systematic 
attention to problems of control, sampling, 
and methodology, and without securing posi- 
tive results, we are now inclined toward this 
pessimistic point of view. The present study 
and other similar investigations have rested 
on the assumption that the physical body, 
the body image, and the drawn figure are in 
isomorphic relation. Given careful explora- 
tion, this one-to-one relationship does not 
seem to exist. 

We are not Prepared, on the other hand, to 
concede that the figure-drawing technique is 


expression displayed by Poliomyelitis children 
in their drawings, F, 


those children whose 
depiction of their orth i 

they, as Machover Suggests, “ 
centered individuals whose wh 
been blighted by 


sonalities, and have no 
their own, and . 


handicap . . . is a more vital m 


€asure than 
the specific concrete Projection” 


(11, p. 264), 
Summary 


Sets of human figure drawings—same 


“Sex, 
pposite-sex, and self-figures—were obt i 


A. B. Silverstein and H. A. Robinson 


poliomyelitis. These drawings were studied 
by three different methods to determine 
whether they reflected the physical disability 
of the subjects. b 

1. By inspection, more than aah : 
of the subjects appeared to represent m 
disability, either directly or indirectly, i 
their drawings, ‘ 

2. Compi of drawings of the det 
children with those of normal Sepa 
equated for age, sex, and IQ, showed a ate 
Significant number of significant mags 
between the two groups on a series 0: 
Scoring signs, sags 

3: fudge, experienced in the i 
Nostic use of figure drawings were unal and 
differentiate the drawings of aang 
normal subjects at a level better than fio ace 

Various hypotheses were suggested weak- 
count for the negative results, and a ts 
ness in the basic assumption seer was 
Present investigation and similar studie: 


e re- 
noted and discussed. Plans for futuri » 


Sage ized an 
search, involving a more indiyidnalize ted 
Personality-centered approach to coe d. 
figure-drawing technique, were outlin 
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A Comparison of Productivity and Fantasy on the 
. . 1,2 
Rorschach and Projective Movement Sequences 


William H. Lundin and Boris Breiger 
Chicago State Hospital 


sparse or unelaborated pro- 
jective records. Clinical utility increases when 
such records more clearly show Psychody- 
namic content. Experience with the Projectiye 
(PMS), a brief 


objects or fragments of 
t, 

» womb,” “broken 

arm,” “dead person,” and (c) descriptions of 

active elaborated Processes, i.e., “embryo be 


1 Based on a Paper read at the 195 e 

the Midwest. Psychol. Ass, Sè Louis ete of 
2 An extended t 

tained without 


mentation Institute. Order Document No. 
ADI Auxiliary Publications Project, 
tion Service, Library 
D.C, remitting in advance $1.25 fi 


4972 from 
Photoduplica- 
Washington 25, 


gress. 


J 6b [= 
ing born,” “arms and legs falling off,” “can 
cer inside my body eating away. n ics 

The sample consisted of 40 age nee 
who were given both tests. Records WE Pis 
lyzed by the sign-rank test, oe te of 
significant beyond the .01 level n Section 
the PMS on the following criteria: PIP otal 
human movement, animal movement if- 
number of personalized fantasies e eiia 
fer significantly: however, number g oreater 
elaborated processes” was significant A static 
on the PMS (.01), and number P the Ror- 
objects” was significantly greater aa f Ss re 
schach (.01). In the sample, 32.5% PMS se- 
jected more Rorschach cards than ment 0” 
quences, 60% saw more human ee 
the PMS, 75% saw more animal veonaliZe 
on the PMS, 62.5% had more per re static 
fantasies on the PMS, 82.5% had ne saw 4 
fantasies on the Rorschach, and ie 
Steater number of elaborated recha 
the PMS. Those Ss who rejected uence. 
cards responded to every PMS pa i (a) 

Several hypotheses are sugges d for M 
stimuli in motion lower the thresho e Ror 
type responses, (b) many times, sociation 
schach reflects the S’s affective he uncon” 
and gives no clear evidence for t vior; (0) 
scious fantasies underlying his b to Biv 
for most of these Ss the PMS seo a borati®g 
the necessary “push” towards Ba the c- 
fantasies and revealing affect whic an W 
nician is then able to interpret 10 
ambiguous manner. 


Brief Report. 
Received May 11, 1956. t 
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A Continuous Performance Test of Brain Damage” 


H. Enger Rosvold,’ Allan F. Mirsky,’ Irwin Sarason, 


4 


Edwin D. Bransome, Jr. and Lloyd H. Beck ° 


Yale University 


Thi 
Vestigation a, presents the results of an in- 
study of E a new instrument for the 
The desi rain damage in human subjects. 
erform ~ of the instrument, the Continuous 
tain elect, ce Test (CPT) was based on cer- 
Suggested toencephalographic evidence which 
Should inp that brain-damaged individuals 
on- ea inferior ability as compared with 
tiring rn. individuals on tasks re- 
|The ae attention or alertness. 
tients everett EEGs of brain-damaged pa- 
hYpersynch ly show either random bursts of 
‘ntruding ronous (high amplitude) activity 
Tain, or ie the normal activity of the 
Yersynch Seneral hypersynchrony (3, 8). 
ronous activity is also evident in 
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the recording from the brain of a sleeping 
subject (3). If hypersynchrony is associated 
with reduced vigilance or attention, as sug- 
gested by its presence during sleep, then the 
hypersynchrony of the brain-damaged pa- 
tients might also indicate reduced attention. 
For example, according to Hebb (1), hyper- 
synchrony might interfere with the sequen- 
tial firing of cell assemblies and thereby dis- 
rupt the process of attention. Other research 
strongly suggests that some such relationship 
does in fact exist. Thus, on the basis of a 
study of 75 prefrontal lobotomy cases, Levin 


states: 

Immediately following operation the patient usu- 
ally lapsed into a drowsy-anergic state from which 
he could be temporarily aroused by stimuli, only to 
se once again into somnolence when the stimuli 
d. During this drowsy-anergic state 
EEGs showed diffuse slow activity and a good deal 
of baseline oscillations of 4 to 2 per second an- 
teriorly mixed with slow rhythms of 2 to 6 per 


second frequency. As the patient emerged from the 


drowsy stage the 
serted itself (2, p- 422). 

The usual measures of attention or alert- 
such as the digit span and digit symbol 
s of the Wechsler-Bellevue 
have not consistently showed decline follow- 
ing brain damage (4, 5, 6, 7). In the case of 
the patient who shows intermittent bursts of 
hypersynchronous activity, and hence only 
momentary lapses in attention, the test per- 
formance may be due to the fact that the S 
can to a great extent choose his own time to 
respond, and may reorganize his attention be- 
tween momentary lapses. The lapses would 
then not affect his score to any measurable 


lap 
were remove! 


preoperative pattern usually as- 


ness 
substitution subtest 


extent. 
In the case of the individual who shows a 


generalized hypersynchrony of the electrical 
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ii e brain, the classical tests might 
mo te i deficiency because they do = 
require sustained attention over a sufficiently 

iod of time. 
g considerations suggested that a test 
which would not allow the patient to choose 
his own time to respond, and which would 
require a high level of continuous attention 
over an appreciable interval of time might 
reflect a deficit that other procedures would 
miss. Accordingly, the CPT was designed to 
provide two attention tasks, labeled X and 
AX, with AX designed to be the more diffi- 
cult. This paper presents data on the CPT 
performance of comparable groups of brain- 
damaged and non-brain-damaged individuals. 
If the research demonstrates that there are 
indeed differences between brain-damaged and 
non-brain-damaged groups on this test, one of 
the questions which arises is whether or not 
the differences are large enough to be of 
diagnostic use, The data also provide a pre- 
liminary answer to this question. 


Method 

Subjects. No attem 
study to select Patien 
» extent, or type of brain damage. The 
is here used to in- 


ied, each Consisting 
da non-brain-dam- 
ective 8roup consisted 


ck 
H. E. Rosvold, A. F. Mirsky, I. Sarason, E. D. Bransome, and L. H. Be 


. » 
were diagnosed as either of “organic me å 
(the Brain-Damaged-Defective pee aa 
of “familial or idiopathic etiology” (the 1 
Brain-Damaged-Defective a a 
Child group comprised 45 children edial 
children’s hospital and from various ait 
ric clinics who were being treated ee 
disorders such as cerebral palsy (he a 
Damaged-Child subgroup) or weet P Di 
Ous-system disorders (the o group, 
aged-Child subgroup). The t hale f 
designated the Adult group, r A 
adult Ss. Half of these (the r being 
Adult subgroup) were either epilep 1 cnet 
treated at a seizure clinic or brain clinic. 
patients being seen at a nemoe T D 
The remaining 24 Ss (the oe of the 
aged-Adult subgroup) were either Emre or 
general medical population of a 
were nonpatient Ss. 


E yere 0b- 
The age and a measure of inele institu- 
tained for all Ss. In addition, the Jene “tie group, 
tionalization was obtained for the De e teste 
The Ss in the Defective group were gr the train- 
on the Stanford-Binet upon admission To just prior 
ing school; all other Ss were tested pte jntelligen© 
to presenting them with the CPT. 


ford- 
the Stan 
measure used for the Child group was ‘Adult grouP 


er-Belle- 


Bellevue, 
vue, the Verbal Scale of the Wechsler Da 
20-minute modification of the o Appr 
ing Test of Mental Ability, rom Adult : 
equal numbers of Ss in each of t Saree of A 
Were tested on each of the three m of the sev’ 4 
gence. The average ages and IQs mean age | 

S le 1. The sig 
groups are presented in Tab 


$ up W% ged- 
ME ck ae h the Non-Brain-Damaged-Child subg n in-Damag? 
of 72 institutionalized feebleminded Ss, who nificantly higher than that of the 
Table 1 
Mean Ages and IQs of the Subjects 
DIQ 
Group N Mean age SD age Mean IQ S 
Defectives 78 
Brain-damaged 29 273 8.1 63.3 7.5 
Non-brain-damaged 43 25.1 78 66.8 
Children 28.2 
Brain-damaged 19 9.0** 3.0 101.9 21.2 
Non-brain-damaged 26 12.3** 29 104.6 
Adults 5 15.2 
Brain-damaged 25 31.7 12.1 s 15.0 
Non-brain-damaged 25 31.5 13.9 100. 


* Indicates a significant difference (b <.05). 
ak Indicates a significant difference (p <.01). 
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[To SHOW PARTS 
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—— 
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i ies 1. Semischematic diagram showing the Con- 
examin, Performance Test apparatus, & subject and 
a test. er in the positions they would occupy during 


Chil 

Brain. wostoup (p < 01). Also, the IQ of the Non- 
igher hntbed-Adult subgroup was significantly 
Stroup TE that of the Brain-Damaged-Adult sub- 
differen? S09). There were no other significant 
with A between the various paired subgroups 
stitutions to age or IQ. The mean length of in- 
Subgroy ization for the Brain-Damaged-Defective 
aged-Def, Was 11.4 years, for the Non-Brain-Dam- 
not Sctive subgroup, 9.3 years. This difference 

Significant, 


4 . . 
trated Gratus. The testing instrument 1s illus- 
teVolving Fig. 1. It consisted essentially of a 

ation drum on which two series, each of 

0 ers, were mounted side by side. 

AX ta Series served for the X task, the other for 
twice a 1); 7¢ drum revolved slowly; approximately 
Visor tira ite in a boxlike case equipped with a 
a Shift ough which the S was required to look. The 
horizg €d the task from X to AX by changing the 
; Uminat Position of the visor. The letters were 
Was pro ed briefly one at a time. The illumination 
"Mounted wet by a bank of five 0.5-watt neon bulbs 
chargin Inside the case, fired by means of the dis- 
È "med: of an 8-microfarad condenser. The S per- 
COrrecgy Y Pressing a response key when certain 
88 a letters appeared. In the X task, every 

lowing Correct letter; in the AX task, every X fol- 
Ato wee A was a correct letter. The letters came 
se.” ât approximately 0.92-sec. intervals. A re- 
Pts ae scored correct if the response key was 
tion op Vithin 0.69 seconds after the brief illumina- 
there. the correct letter. Following this interval, 
before i a period of approximately 0.23 seconds 
Correc! e next letter was illuminated. Correct an 
responses were recorded automatically on 
counters facing the back of the machine 
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where E sat. The X task was always presented first 
and included eight X’s in the series of thirty-one let- 
ters. The responses occurring over the first two revo- 
lutions of the drum served as practice and were not 
counted in the S’s score. The Ss were then given 
either a 5-minute test (10 revolutions) in which 
there were SO possible correct X responses, or a 10- 
minute test (20 revolutions) in which there were 
160 possible correct responses. Following a 2-minute 
rest period, the visor was moved by E so that the 
AX series was in view. There were six correct AX 
sequences among the thirty-one letters of the AX 
series. As with the X task, the responses occurring 
during the first two drum revolutions served as 
practice. Then, the Ss received either a 5-minute 
test in which there were 60 possible correct AX re- 
sponses, Or @ 10-minute test, in which there were 
120 possible correct. 


Procedure. No attempt was made to keep 
the instructions completely identical from S 
to S; the typical form, however, did not vary 
greatly from this content: 


“Do you see this viewer? When the machine starts, 
you will see letters appearing one at a time. Your 
job is to press this key every time you see an x 
Don’t press it for any other letter and always press 
it when you see an X. Press the key down for a bit 
when you see an X; don’t hit it too quickly. Try 
holding your eyes different distances from the viewer 
until you find the one a: is n ee for 

ber, press the key eve! 
gery is ay other letter.” Those Ss who had 
difficulty jn understanding were given further in- 
struction of the same sort. 


: -minute rest 
With the X task and the two minu 
period completed, the 5 was instructed as 


follows: 


i i the 
sob in this next part is again to press 
Et peg n X, but this time, only if the 


key when you see a ; hen you see 
i ter an A. That is, W en y 
X follows right af ri the key on the X. Don’t 


A jae T ; 
ee or for jo other letter ellen an A 
i now. 

Iways press it then. Remember ; 

zo a Pa t set; if an X comes 


i » Additional instruction 
ne ne E press the Ke ifcalty in under- 
standing. 

Except for the children, all Ss were tested 
for 10 minutes on each of the two tasks. With 
children, the time was reduced to 5 minutes 
on each task, and in addition, the instructions 
were modified to some extent, presenting the 
task as a game. For the children under the 
age of 10, pretesting was carried out to make 
certain that they could discriminate letters, 


and to see whether they could follow the in- 
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structions by requiring answers to two spe- 
cial test sheets, one containing Xs among 
other letters, the other, As and Xs among 
other letters. Those who failed this pretest 
were not tested further. No S was tested who 
could not perform the minimal motor tasks 
of holding his head up unsupported and press- 
ing the response key. Since the testing was 
conducted at many different clinics and hos- 
Pitals, it was not feasible to control exactly 
the amount of illumination in the testing 
room. The ordinary lighting of the room was 
used without any modification; care was 
taken however, to insure that there was no 
glare on the visor of the testing apparatus, 
Reliability. Two measures of the reliability 
of the CPT were made, using Ss of the De- 
fective group. Odd-even reliability was deter- 
mined from the scores of 21 non-brain-dam- 


aged Ss, by comparing the subtotal of correct 
responses on the 10 even 


drum with the subtotal 
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of correct responses the § made divided by 
the number of correct responses (X 100) pos- 
sible in the time allowed. The relative per- 
centage correct was defined as the number of 
correct responses (X 100) the S made di- 
vided by his number of attempts (both cor- 
rect and incorrect) during the time allowed. 
In the event that the two scores differe 
markedly, depending on the S’s pattern of re- 
sponding, the two measures provided a ae 
complete description of his performance tha 
would either of the two taken singly. 


Results 


CPT scores. Table 2 presents the pa 
and standard deviations of the absolute ni 
centage of possible correct responses Since 
X and AX tasks for the six subgroups. ai 
there was a significant age difference beia 
the Child subgroups and a significant ‘rable 
ference between the Adult subgroups sub- 
1), the differences between the paired two 
group means on X and AX in these aly- 
groups were evaluated by means of an “Child 
sis of covariance. The means of the nee 
group in Table 2 have been adjusted ult 
gression on age and the means of the n on 
group have been adjusted for vera de 
IQ. The covariance procedure was an 
for heterogeneity of variance be we he 
subgroups when the analysis required it. 
mean differences in the Defective group 
evaluated by means of the ¢ test. means 

The differences between the subgroup" ad 
were highly significant on both the 


were 


Adjusted M aie 
justed Means ae eanlard Deviations for Child and Adult Groups, Means and Standard Deviations fo 
e Groups, X and AX A solute Percentage ‘Gorrect Measures 
Brain-dama 
eed Non-brain-damaged 
G Anj > iff. 
Troup mean SD " Adj. sip p die 
i 
Children mean aii 
x 19 41.61 <0 
AX 19 46.46 a 26 82.57 14.65 <.0005 
Adults 26 79.41 17.44 30 
x 25 78.53 28.26 >: 
F $ 1 
AX 23 61.40 Bae 3 88.00 17.21 2.0 
Defectives 78.77 15.33 ot 
x 29 46.44 32.02 < "5005 
. -l 00: 
AX 29 3230 2579 R se eau 
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Table 3 


Significance Levels of Differences Between X and AX 
Scores, for Relative and Absolute Measures 
of Performance, All Groups 
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Table 4 


Significance Levels of Differences Between Adjusted 
AX Mean Scores of Brain-Damaged and Non- 
Brain-Damaged Subgroups, All Groups 


Non- 


Brain-damaged brain-damaged 


Group Absolute Relative Absolute Relative 
Gu 
apen >70 > 30 >50 >70 
Deleon <.001  <.01 <01  <.05 
Ctives  <.01 <.001 <.001 <.001 


Performance measure 


——— 


Group Absolute Relative 
Children >.20 <.05 
Adults <.01 >.05 
Defectives <.05 <.05 


= tasks in the Defective group ($ < 01 
chid o .005, respectively) and also in the 
uft group (p < .0005 in each case). In the 
Wass Geek the brain-damaged subgroup 
Significantly inferior to its controls on 
wes .01), but not on X (p > -30)- 
Paired a relative percentage scores of the 
Pared þ hild and Adult subgroups were com- 
and th y means of an analysis of covariance, 
of the Ose of the Defective group by means 
Were fe test, the paired subgroup differences 
Mately the the same direction and of approxi- 
in Table 5 me magnitude as those reported 
no Sie | 2. The levels of significance were 10 
Ported Jess than the corresponding levels re- 
that ihe. Table 2. The only difference was 
Ctimin relative scores on the X task dis- 
the ae significantly (p < .05) between 
Scores ult subgroups, whereas the absolute 
"es on the X task (Table 2) did not. 
Order to determine if the AX task was 


in fact more difficult than the X task, the 
mean X score was compared with the mean 
AX score for each of the six subgroups. 
Table 3 presents the significance levels from 
the ¢ test of the differences between X and 
AX scores for both the relative and absolute 
measures of performance in all six subgroups. 
Each of the Defective and Adult subgroups 
performed significantly worse (at p <05 or 
less) on the AX than on the X task. With the 
children, none of the differences between X 
and AX was significant. To determine if the 
brain-damaged subgroups had relatively more 
difficulty on 4 , independent of their 


performance on X) than the non-brain-dam- 


aged ae a 
was run on the X scores 
damaged and non-brain-damaged subgroups 
with “x scores as the covariate. Table 4, 
which presents the results of the analysis, 
shows that in terms of the absolute measures 


Table 5 


Percentages of Correct Identific 


ation of Diagnostic Category b; 


y CPT Scores, All Groups 


Group 
Defectives Children Adults 
efecti —— 
i Brain- Non-brain- 
R Brain- Non-brain- 
Ubgroup Ps ain- 4 — damaged damaged damaged damaged 
amage amagi 
: Ba Boe Go 
XR 29 43 re g4.2*** 76.9*** d d 
X~4 75.98% 67A Sose 70.9%" 64.0 64.0 
AX_pR 62.0 58.1 gues 76.9%" 66.7* 66.7 
AKA 72.4** 65.1" gaze  76.9*** 65.0} 65.0} 
k 75.9%** 67.4* 
a? <.05, 
wP <01. 
+ RS 005 
Sign igote pability that the percentage differs from chance (50%). Nonstarred percentages do not differ 
ability 
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of performance, -the Brain-Damaged-Adult 
and -Defective subgroups had significantly 
greater difficulty on the AX task than their 
respective nondamaged subgroups, even when 
the paired subgroups were adjusted to equal 
levels of performance on the X task. Simi- 
larly, in terms of the relative measures of 
performance, the Brain-Damaged-Child and 
-Defective subgroups had significantly greater 
difficulty on AX than their respective non- 
damaged subgroups. 


Correct identification of subgroup. Table 5 
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presents the percentages of correct identifica- 
tion of diagnostic category of all the sub- 
groups on all measures yielded by the CPT. 
These were determined for each subgroup on 
each CPT measure from the over-all median 
of scores of a group on that measure. For ex- 
ample, considering the X scores in the De- 
fective group, the percentage of brain-dam- 
aged Ss scoring below the combined Defec- 
tive group median defines the percentage of 
Correct identification of brain-damaged defec- 
tives on the X task. Similarly, the percent- 
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age of non-brain-damaged defectives scoring 


` above the over-all median defines the per- 


centage of correct identification of non-brain- 
damaged defectives on the X task. These 
Percentages were computed to provide an 
estimate of the potential usefulness of the 
several scores of the CPT as diagnostic indi- 
cators in various clinical groups. In Table 5, 
X-R and AX-R refer to the relative meas- 
ures of performance on these tasks; X-A and 
AX-A refer to the absolute measures of per- 
formance. The relative measures provided 
More significant percentages of correct identi- 
fication than did the absolute measures; all 
of the six X-R and all of the six AX-R sub- 
group percentages were significant at p < 05. 

he Child group had more significant per- 
centages of correct identification than any 
other (eight of eight) all of which were sig- 
nificant at p < 005. There were equal num- 
2ets of significant percentages of correct 
identification among the non-brain-damaged 
and brain-damaged subgroups; however, these 
Percentages tended to be higher among the 

rain-damaged subgroups. 

Figure 2 presents for each group and GPT 
Measure, the distribution by percentage score 
o rain-damaged and non-brain-damaged Ss 
(uncorrected for age ot IO aiam be- 
Ween subgroups). Figure 2 emphasizes 1n 
peneral the great range in scores achieved by 

rain-damaged Ss as compared with non- 
rain-damaged Ss. The scores of the non- 
rain-damaged Ss are usually concentrated 
near the upper end of the distribution; in 
fact, the modal score for non-brain-damaged 
Ss is in the 91 to 100% interval in every cast 
except for the AX-A measure in the Defective 
roun, In contrast with this, the scores of the 
prain-damaged Ss span the entire distribu- 
a or the entire distribution excepting one 
Ore interval, in every case. 


Discussion i 

The results of this study indicate that brain- 
Pens individuals perform poorly relative 
© Non-brain-damaged controls on a task re- 
rng continuous attention. The results also 
ndicate that on a task designed to require 
ven more sustained attention the brain-dam- 
ged individuals perform even more poorly. 

e score distributions of the various sub- 
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groups (Figure 2) and the percentages of in- 
dividuals correctly identifed by diagnostic 
category (Table 5) suggest that the CPT is 
sufficiently sensitive to the effects of brain 
damage so that it might prove useful clini- 
cally. The data of Table 5 suggest that the 
relative measures are more discriminating 
than the absolute measures, that the test is 
somewhat more reliable in reflecting the 
presence than the absence of brain damage 
and that it is most discriminating when ap- 
plied to the children of this study. 

These findings are of course preliminary. 
Use of the CPT in the clinic must await 
standardization on a variety of diagnostic 
groups, to ascertain whether brain pathology 
only and which types of brain pathology 
lead to deficient performance. For example, 
some data which have not been reported here 
indicate that schizophrenics perform no dif- 
ferently from normals of comparable age and 
IQ. More information concerning other groups 
is required. Standardization on a variety of 
diagnostic groups is also necessary in order 
to have a reliable diagnostic score for each 
subgroup. Thus, in the present study, cutoff 
points which included most brain-damaged 
children missed many brain-damaged adults 
(see Figure 2). . f 

Diagnostic considerations aside, the ques- 
tion remains as to whether the impaired per- 
formance of the brain-damaged Ss on the 
CPT is in fact due to an impairment of at- 
tention, whether in the form of momentary 
lapses, or of a lowering of a general level. 
Clearly, the available information does not 
rule out alternate interpretations of the defi- 
cit. To make certain that it 1s attention that 
is impaired would require more extensive in- 
formation about the S’s test behavior than 
the present instrument provides. It is clear, 
furthermore, that the available information 
does not permit the conclusion that the im- 
paired CPT performance is indeed related to 
hypersynchrony as evident in the EEG. 
Nonetheless, the results of this study do lend 
support to these hypotheses suggesting that it 
might now be profitable to make a more di- 
rect test of the original formulation. This test 
would be provided by simultaneously measur- 
ing CPT performance and brain activity to 
determine whether errors on the CPT are 
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coincident in time with hypersynchronous 
patterns on the EEG and whether there is a 
correlation between degree of deficit on the 
CPT and degree of hypersynchrony. 


Summary 


1. The Continuous Performance Test, a 
procedure for the detection and study of brain 
damage in humans, is described. 

2. Three groups of Ss, each including a 
brain-damaged and a non-brain-damaged sub- 
group, were tested on this procedure. 

3. The brain-damaged subgroups were sig- 
nificantly inferior to their non-brain-damaged 
controls on the measures yielded by the CPT, 
and these differences were increased when the 
difficulty of the task was increased. 

4. The CPT is sufficiently reliable and 
yields sufficiently large differences between 
subgroups to suggest that it might ultimately 
Prove useful as a clinical instrument for the 
diagnosis of brain damage. 

5. An interpretation of the inferior per- 
formance of the brain-damaged Ss was offered 
in terms of impairment in attention or alert- 
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ness and suggestions were made about po 
research relating cerebral events and CP 
performance. 
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ig fe ea bs formal stimulus characteristics 
interpretatic ged. to be of importance in the 
cation of 7 of projective test data. Clarifi- 
Sponses ha, e meaning of projective test re- 
stimulus A heen, sought through study of 
6, 8, 12 qualities in a number of areas (1, 2, 
eat 16 15). 

ta pyre to the Rorschach test, the role 
Teceived sy = Production of a response has 
cept of eee little attention. The con- 
mal blot energies implies that for- 
the Karsch aracteristics of certain areas of 
response a tend to call forth a particular 
tained a s anzoni, Grant, and Ives (10) ob- 
ation spe of norms for an adolescent popu- 
to elicit eS ying which cards were most likely 
etermina Sponses using a particular location, 
ot Cicer t, and content. Their study was 
nd made ned primarily with form, however, 
he Rorsch no attempt to vary the forms of 
Order of ¢ ach stimuli or to place them in an 
lished a t omplexity. Meer’s study (9) estab- 
culty n e order of organizational diffi- 
Specify the ng cards, but did not attempt to 
or stimul factors believed to be responsible 
tachistose Us ease or difficulty. Stein’s (11) 
Strateg ies exposure of the cards demon- 
et im at perception was less adequate un- 
again Fear ssi stimulus conditions but 
» the stimulus condition as a whole was 


1A d 
fulin 


tor of p 


of 


h 
chologigt 4,224 also Dr. Bernard Locke, Chief Psy- 
Sible the’ New York VA Hospital, for making pos- 
© gathering of the data. 


varied, with no attempt to focus on form as 
the variable for study. 

The present study investigated by means 
of a non-Rorschach perceptual task the gen- 
eral hypothesis that stimulus ambiguity is an 
important determinant of perceptual ade- 
quacy. Degree of maladjustment was a sec- 
ond variable studied in line with Forer’s (5) 
suggestion that degree of personality integra- 
tion is a determining factor in the differential 
adequacy with which an individual perceives 
in situations of varying ambiguity. 

It was hoped that variation of the form of 
the stimulus, isolated from as many other 
stimulus characteristics as possible, would 
provide a general basis upon which to in- 
terpret individual projective records, though 
the limits of applicability to any specific test 
are fully realized. As in Stein’s (11) study, 
response characteristics were evaluated in 
terms of perceptual adequacy, defined so as 
to include both formal and content charac- 
teristics of the response. The specific hypothe- 
that both increasing stimulus am- 
ncreasing degree of pathology 
in decreased perceptual ade- 


sis was 
biguity and i 
would result 


quacy. 
Procedure 


In order to limit investigation as much as 
possible to form alone, sixty figures were ran- 
domly cut from black paper and mounted on 
white cards, leaving only the blackness of the 
figure as a confounding factor. Seventeen psy- 
chologists rated each figure as most, least, or 
moderately structured, using as their criterion 
of structuredness the relative ease with which 
each figure suggested a percept. From these 
judgments five figures were clearly chosen as 


351 


352 


the most structured (Structure I), five as 
moderately structured (Structure II), and five 
as least structured (Structure III). The 15 
figures were arranged in random order for 
standardized presentation to the subjects. 
This “subjective consensus” method of defin- 
ing stimulus ambiguity, though it has the 
disadvantage of risking bias through the use 
of only psychologists as judges, affords a 
definition of ambiguity in psychological, 
rather than physical, terms. The psychologi- 
cal definition was deemed more appropriate 
to the present study. 

Thirty Ss were chosen from each of three 
nosological groups: neurotic, latent schizo- 
phrenic, and hospitalized schizophrenic, as 
diagnosed either by their outpatient thera- 
pists or ward physicians. By using this or- 
dinal scale of degree of maladjustment, it was 
hoped that unreliability in ratings of malad- 
justment could be avoided. The three groups 
were matched for age and education, Analy- 
sis of variance and Bartlett’s test showed no 
reason to suspect that either 
ances differed significantly. The mean age of 


was the examiner’s onl 
clarification of 
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Table 1 


Number of Patients Receiving All “1” Ratings 
on Form Level 


Stimulus Ambiguity 


Group I II Ul 
Neurotics 28 19 % 
Latent schizophrenics 25 13 
Hospitalized schizophrenics 17 3 1 


The following categories were employed in 
evaluating the perceptual quality of the re- 
sponses: 


Form Level: a four-point rating scale measuring 
judged goodness of fit of percept to stimulus. Scale 
Points were named 7. adequate form, 2. vague form, 
3. poor form, and 4, very poor form. 

Structural Peculiarities : (a) Fabulation was a a 
sponse which added a great deal more to the percep! 
than could reasonably be assumed from the pumi 
lus (“Miss Olsen’s profile,” “a person who died n 
pneumonia.”) (b) Incongruity was a percept wale 
Parts do not belong together (“a person with 1g 
meat cleaver attached to his head,” “a rabbit—here 
the opening in his shell.”) se. 

Sex Response: Any overt genital or anal response: 


Other content categories were scored, but 
occurred infrequently and could not be score 
reliably. A Total Pathology rating scale was 
also used, but because of its high correlation 
with the Form Level scale, added little fur- 
ther information, + at 

Each response was typed and coded indi- 
vidually and the ninety responses to each fig- 
ure were scored consecutively by the writer. 
One-third of the total responses were sub- 
mitted for a reliability check to two other 


ural Peculiariti i , d 
Combined Bike ee With Cochran’s Q Test an 


y Measure 
Stimulus ambigui 
guty ined 
— oen Order Combine 
Teee I N m o p probability probability 
seers 1 29 28 oe ae Tk 714 
atent schizophrenics 21 19 45 a. .308 / 


Hospitalized schizophrenics 
All groups 


.080 


tn «295 


794 


1/6 


A 
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psychologists.? Through a method described 
in detail elsewhere (7), scoring reliability was 
determined and was deemed good enough to 
permit using the writer’s scoring in the 
evaluation of the data. 


Results 


Table 1 shows the number of patients all 
of whose responses received Form Level scores 
of “1,” by clinical group and by stimulus 
Structure. The number of patients receiving 
all “7” ratings decreased regularly both as 
Stimuli became more ambiguous and as pa- 
thology increased. A nonparametric signifi- 
cance test was performed as follows. For nine 
Cells there are 9! possible arrangements, an d 
5 these 9! arrangements only 42 can be 
ound such that in every row the frequencies 
Sin from left to right and in every 
Pia decrease from top to bottom. Ac- 
c ingly, the probability of obtaining by 
a SE alone data showing this regular de- 
bi ase in Form Level with increasingly am- 
home| and with increasing degree of illness 

2/91, or 0001156. 

teu 1 suggested the possibility that the 
com of decline in Form Level as stimuli be- 
Psych more ambiguous might be greater as 
Was pe Pathology increases. This supposition 
ecli ested in the following manner. A rate of 
tractin Score was obtained for each S by sub- 
Stru a the sum of his Form Level scores for 
score ure I from the sum of his Form Level 
Sens for Structure III and dividing this dif- 
ture 1 by the sum of Structure I and sioe 
ecli; I Form Level sums. The mean rate o 
atent. Score for neurotics was 0759, for 
zed Schizophrenics .1223, and for hospital- 
schizophrenics .1935. An analysis of 


Zir, 
Most k 


i 


_ Gerald Bauman and Dr. Melvin Kornreich 
Indly acted as judges. 
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Table 3 


Number of Patients Who Give No 
Structural Peculiarity 


Group Number* 
Neurotics 25 
Latent schizophrenics 11 
Hospitalized schizophrenics 12 


* Chi square = 7.61; p < .05. 


variance resulted in an F value of 4.95, sig- 
nificant at the .01 level for 2 and 87 degrees 
of freedom. 

The incidence of Structural Peculiarities is 
shown in Table 2. Columns I, II, and III in- 
dicate the number of patients who did not re- 
spond with a Structural Peculiarity to any 
one of the five figures of each structural 
level. In order to test the hypothesis that 
incidence of Structural Peculiarities is a 
function of stimulus ambiguity, Cochran’s Q 
test (3), a variant of chi square that does 
not require independence of observations, was 
used. None of the probabilities (Column six, 
Table 2) associated with Q values reaches 
statistical significance, but when account is 
taken of the fact that the predicted order 
across rows was obtained in each case (13), 
the probability value for the entire sample is 
seen to be .031. The usual chi-square test ap- 
plied to the relationship between degree of 
maladjustment and incidence of Structural 
Peculiarities (Table 3) gave a chi-square 
value of 7.61, associated with a probability 
value less than .05. Inspection reveals that 
the significance of this measure is derived 
largely from the relative absence of Struc- 
tural Peculiarities in the neurotic group. 

Table 4 indicates the number of patients 
showing no Sex responses to cards of differ- 
ent stimulus structures. Again using Cochran’s 


Table 4 


Number of Patients Withou 


t Sex Responses, 
d Probability Measure 


With Cochran’s Q Test and 


Combine! 
Stimulus ambiguity Gs — 
i, ñ m Q d probability probability 
3.80 .142 1/6 053 
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Table 5 


Number of Patients Who Give No 
Sex Response 


Group Number* 
Neurotics 29 
Latent schizophrenics 22 
Hospitalized schizophrenics 25 


* Chi square = 98; p > .05. 


Q test and combining Probabilities, the asso- 
ciation between stimulus structure and inci- 
dence of Sex responses is seen to be of border- 
line significance (p = .053). 

Table 5 indicates the number of patients 
giving no Sex responses. The chi-square value 
of .98 is associated with a probability greater 
than .05. Accordingly the hypothesis that 
incidence of Sex Tesponses is a function of 
degree of maladjustment must be rejected. 


Discussion 


Perceptual distortion as measured by form 
accuracy is thus seen to be a function of both 


terpreter suspicious of a 
whereas an accumulation 


M. Powell Lawton 


less well-structured areas would be required 
to give the same impression. The present re- 
sults would tend to confirm Meer’s (9) sup- 
position that an important factor in deter- 
mining Rorschach card difficulty is stimulus 
ambiguity. A problem for further research 
might involve the development of a more 
discriminating Rorschach F + % than Js 
Presently used by weighting more heavily 
those ¥ — responses that occur to highly 
structured areas. 

On the other hand, the equivocal results 
obtained in the attempt to relate Structural 
Peculiarities and Sex responses to stimulus 
structure make interpretation somewhat diffi- 
cult. It may be that there is actually a 
Sreater contribution of internal factors than 
of stimulus factors in the production of these 
content-related distortions, though the pres- 
ent study does not answer this question. ee 
Supposition is reasonable if one considers tha 
Standards of what is appropriate in matters 
of content are largely internal, in ours 
to the Form Level dimension, where pr 
model against which the appropriateness iis 
the S’s association is tested is physically 
present in the stimulus. ” 

The differential rates of decline in poi 
Level with increasing ambiguity among i 
three clinical groups offers experimental verl i 
cation of the observation that the more san 
adjusted individuals “go to pieces” mo i 
easily than the less maladjusted. Not only e 
there a difference in adaptive ability, but t 7 
difference becomes wider as the external situa 
tion becomes more demanding, in the sense rs 
forcing the individual to provide structure k 
an ambiguous field from within himself. Ba 
a finding would suggest that the best a 
ferentiation among groups according to a 
Sree of maladjustment would come from a i 
ing the Form Level of the more arene 
cards. This supposition was tested by ie 4) 
man, Gursslin, Kaplan, and Sharlock aa 
who found that an F + % which exclu a 
Popular responses from consideration be 
more discriminating between normals 4 
neurotics than Beck’s or Hertz’s F + %. 


Summary 


vel 
As a means of exploring the Form a 
dimension in projective perception, a me 


| 


Stimulus Structure and Perceptual Response 


was devised to test the hypothesis that both 
increasing stimulus ambiguity and increasing 
personality maladjustment would have an ad- 
Verse effect upon perceptual adequacy. Black 
Paper cutouts of three ranked degrees of am- 
biguity were presented in Rorschach fashion 
to three groups of patients representing three 
degrees of maladjustment. It was found that 
both greater stimulus ambiguity and greater 
Personality maladjustment were associated 
With lesser perceptual adequacy, as measured 
by Form Level, Perceptual adequacy as meas- 
ured by several indices involving response 
Content and organization of content was seen 
to have an equivocal relationship to stimulus 
ambiguity and to personality maladjustment. 
Tt was concluded that stimulus characteristics 
ate often important determinants of projec- 
tive responses and that consideration of form 
ambiguity is necessary to the best interpreta- 
tion of Projective records. 


Received November 21, 1955. 
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Manifest Anxiety and the Palmat Perspiration Index’ 


Allen D. Calvin, F. J. McGuigan, Sybil Tyrrell, 
and Marshall Soyars 
Hollins College 


During the last few years the Taylor A 
scale has become an increasingly important 
measure of manifest anxiety. During the same 
period Mowrer and others from the Univer- 
sity of Illinois have been developing the 
Palmar Perspiration Index (PPI) as a meas- 
ure of psychological tension. The present 
study is an attempt to investigate the rela- 
tionship between the A scale and the PPI, 


iserial Correlation of 35 
< .05) was obtained between Self-ratings a 


A scale Scores, and a biserial of -17 (not sig- 
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nificant) was obtained between self-ratings 
and the PPT, 

The failure to find a correlation between 
A-scale scores and PPI scores was unex- 
pected since at first glance both seem to be 
measuring somewhat the same variable. How- 
ever Beam (1) in a study published after ee 
completion of our experiment, reports that he 
too found no significant relationship between 
the PPI and A scale. He points out that his 
Taylor scores fell within the middle ae 
and were fairly homogeneous. Our a 
Scores had a mean of 16.9 with an SD p 
6.9, indicating considerable scatter within oe 
Stroup. It seems highly unlikely that our 5 $ 
ure to obtain a significant relationship be 
tween A scale and PPI scores can be ascribe 
to too much homogeneity within our group. 3 

On the basis of our findings and oms 
studies of anxiety the following hypothesis a 
proposed: The A scale and the PPI miegu e 
two different facets of behavior. Where a Si 
iety is of a temporary “ego-involved” situ z 
tional nature, the appropriate measure. A 
drive is the PPI. Conversely, where anen 
is a stable permanent personality charac a 
istic of the individual the appropriate mea 
ure of drive is the A scale. 


Brief Report. 
Received April 26, 1956. 
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Effective Intelligence as Measured by an Unstructured 
Sentence-Completion Technique’ 


George E. Copple 


Vanderbilt University 


Numerous varieties of test material and 
oat Procedure have been used in assessing 
the intellectual functioning of children. Al- 
Most all these procedures have involved rather 
Strict structuring, and this structuring has 
ordinarily been considered a merit of the 
Procedure, Perhaps because of this emphasis 
tin easily scored, “right or wrong” answers, 
tion Possibilities of using a sentence-comple- 
bee technique to evaluate intelligence have 
<tr gay overlooked. The present study 
whi escribe a sentence-completion technique 
ae „has been developed as a measure of 
o fective intelligence” and will present data 
n its usefulness, 


Earlier Uses of Sentence Completions 


kno sinning with Ebbinghaus (1), and best 
be rom its inclusion on the Stanford- 
Eai (2), one type of sentence completion 
Sen Ong been used as an indicator of intelli- 
«ce In this type, most of the- sentence 1s 
Sven, with only a connective word omitted. 
“ceptable choices for this omitted word are 
a limited and an answer is either “right” 
lar Wrong.” M. R. Trabue (3) used a simi- 
is Method in a large-scale study. He called 
th test “language scales” and it is obvious 
Bier knowledge of word meanings and lan- 
a Se usage played the greatest part in de- 
pining a successful performance. 
cop © Other, and more recent, use of sentence 
™pletions has been to evaluate personality 
adjustment. Every survey of projective 


techn: , 
®chniques is likely to have a section or 4 


This article represents a revision of a paper pre- 
at a meeting of the Southern Society for Phi- 


pay and Psychol in Atlanta, Georgia, on 
Pril 16,1984 ychology in anta, J 


chapter on sentence-completion techniques. 
These techniques are usually for adults, they 
consist of “loaded” stems intended to tap 
specific areas of adjustment (“My greatest 
weakness is...” or “I think that most 
mothers . . .”), and the responses are evalu- 
ated for content, particularly dynamic con- 
tent. The level of ability shown by the com- 
pletions and the range and depth of interests 
are ignored. 

The use of the sentence-completion tech- 
nique to be described in the present paper is 
different from these other uses reported in 
the literature in general purpose, technique 
of administration, and rationale. 


Rationale 


Most intelligence-test items demand little 
that is creative or even integrative of the per- 
son being tested. They provide a task or a 
problem that has a narrow range of correct 
answers. They provide a great deal of struc- 
turing and often call for a single word or 
phrase or brief explanation. Typical items 
are: “What is the thing to do if you are on 
your way to school and see that you are in 
danger of being late?” “What is the color of 
rubies?” “How are a coat and a dress alike 
or the same?” “Sky is to blue as grass is to 
.’ Undoubtedly items of this kind give 
some valid indication of a subject’s intelli- 
gence. But when a test is composed exclu- 
sively or mostly of such items, some impor- 
tant aspects of intelligence are left out. The 
individual who can readily place Brazil in 
South America, Egypt in Africa, or India in 
Asia, may not be able to respond successfully 
if asked instead to name one country in each 
of these continents. With still less structur- 
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ing, as for example in responding to the in- 
struction to give the best sentence comple- 
tion he can to the stimulus “In other coun- 
tries . . .,” he may give us something inept 
and vague such as “things are different” or 
“they are foreigners.” One limitation of virtu- 
ally all intelligence tests is just this failure 
to let the subject do enough—the failure to 
let him show us what he can do and does do 
when the stage is not too completely set. 

An example may be useful. Here are two 
nine-year-old boys who are completing the 
stimulus-stem “A piece of string. . . .” One 
completes it “is long.” The other supplies 
“can be used to make a bow and arrow.” 
This latter is obviously a far superior an- 
swer. It is most unlikely, however, that the 
first boy was ignorant of the fact which the 
second boy’s completion utilized. On a more 
conventional test item calling for this infor- 
mation, such as, “A bow is made of 
and ;? both boys would probably be 
able to answer correctly. But does not the 
second boy’s method of completing the sen- 
tence show something in addition to the pos- 
session of information? Does not this “ 
thing” seem to be basic t 
school and nonschool perf 
label “intelligence”? 


some- 


O many types of 
ormance that we 


Administration is alwa 
sponses by the subject, 
examiner. The procedure 


ys individual, with oral Te- 
which are recorded by the 


exi enables young children or 
illiterates to respond as fully as they are able, with- 


out penalizing or limiting them in any way. It per- 
mits people in all age groups to use natural con- 
versational completions without regard to avoiding 
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words they cannot spell. At the other extreme, it 
discourages “literary” completions. Experience seems 
to show that it is unnecessary to limit the time a 
subject can use in framing his responses. As a nile, 
the longer the delay, the poorer the response (ex- 
cept for extremely brief latencies). 

In introducing the test, the subject is told that he 
will be given some words and that he is to add some 
more words so as to produce the very best sentence 
he can make. A sample stem is given the subject 
and two ways of completing it are presented, one 
being designated as “better” than the other. For ex- 
ample, the stem might be “The house... .” One 
way to complete it, the subject is told, would be to 
say “is large.” Another, and a better way, would be 
to say “stood in the bend of the road.” Nothing is 
said about why the latter is better, and subjects as 
young as five years accept this as a self-evident 
superiority. 

With this brief introduction, the test is begun. It 
requires about 15 minutes to complete. It is rare, 
even at age five, to have a child say “I don’t know’ 
to even a single item. Few persons seem to experi- 
ence any sense of failure in completing the sentences. 
The intrinsic interest is high and no matter at what 
level the individual is performing, he is likely to 
consider that he is doing well. This feature, of course, 
is a particular virtue when a whole battery of tests 
is to be given or when a subject is to be worke 
with therapeutically, 


Scoring the Responses 


Each response is scored 0; 1,2, or 3 m 
accordance with prepared scoring standards. 
These standards reflect such consist 
as relevance, complexity, descriptiveness, a0 
Tange or scope. Numerous examples me 
been provided for each score value on each 
item. Judgment is still necessary, but in nu- 
merous studies the agreement in scoring has 
been high (r = .95 or above). For a 
in one study using 24 protocols and with 1 
Psychology graduate students as scorers, a on 
of whom had had any previous esperita 
with the test, the median interscorer reliabil- 
ity was .97. sanli 

The split-half reliabilities of the test itse a 
have been uniformly high. For the three stu i 
ies reported below, these reliabilities (cov 
rected by the Spearman-Brown formula) 
were respectively .94, .95, and .93. No test 
retest data have been gathered. 


Measuring “Effective Intelligence” 
(Validity) 


The most valuable criterion for a test o 
“effective intelligence” would be the judg 
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A New Sentence-Completion Technique 


Table 1 
CSCT Scores for Three Age Groups 


Mean 
Age Test 
Group N Score Sigma CR 
9-6 29 40.76 8.98 
3i ie 2.97 2 leve! 
10-6 7 477 el ee a 
11-6 20 53.85 11.73 fl 


Ments of objective, well-trained observers on 
the actual behavioral efficiency of large num- 
ers of individuals carrying out a variety of 
tasks. Such a criterion is not available, and 
the “construct validity” of a measure of ef- 
fective intelligence must be examined by di- 
verse approaches, 
clationship of test scores to age. Two 
Studies with data relevant to the relation- 
Ship between test scores and CA can be cited. 
B the first, Form B of the CSCT was ad- 
"istered to all the children in two repre- 
ae schools in Davidson County, Ten- 
as a metropolitan community, who were 
thin three weeks of being 9-6, 10-6, and 
for a years of age. Table 1 contains the data 
Seen e 66 children in this study. As may be 
tathe the two older groups of the study are 
par T small. If they are combined and com- 
in > with the younger group, the difference 
ee Scores is significant well beyond the 
evel. 
ae Second study of the relationship of CSCT 
res to age was carried out with a group of 
°tphanage children, again using Form B 
man CSCT. These children ranged in cA 
129.6 S from 97 to 154, with a mean o 
corr e and a sigma of 15.7. The obtained 
relation between chronological age and 
but Scores is significant at the .0001 level, 
this is not very informative. The size of 
meas, between chronological age and any 
ioe of mental age will be greatly in- 
chro; ced by the range and distribution of 
neede SA ages included. What is really 
etwecr therefore, is an indication of the 7s 
‘Now; en CAs and mental ages on other well- 
avail, s tests within this same group. This is 
rn le on this group of 50 children for the 
Bin €nough Draw-A-Man Test, but for the 
St, only 33 of the 50 subjects were tested. 


Table 2 


Correlations Between Age and Scores on 
Three Difierent Tests 


Sample A’ 


Sample A (A plus 17 
Test (V=33) additional) 
CSCT (Form B) 584 577 
Binet (Form L) 621 
Goodenough DAM 294 400 


All of the tests—Form L of the Binet, the 
Goodenough, and the CSCT—were adminis- 
tered within a period of five or six weeks. 
The Goodenough drawings were collected and 
scored by an advanced graduate student, and 
the same student administered the CSCT, 
which was, however, scored by the author. 
In Table 2 the correlations of each of the 
tests with ages in months are shown. In com- 
puting these correlations, mental ages were 
used for the Binet and Goodenough data. 

Relationship of test scores to scholastic 
achievement. A widely used criterion of an 
intelligence test’s validity is the correlation 
of the test with school achievement. Form B 
of the CSCT and Forms L and M of the 
Binet were given, plus the Stanford Achieve- 
ment Test, to a group of 67 orphanage chil- 
dren aged 9-13, none of whom were in the 
study described above. As a group these chil- 
dren were retarded, as shown by a Binet IQ 
range (L and M were averaged) of 67.5 to 
98. Table 3 summarizes the pertinent data 
on this group. The range of intellectual abil- 
ity and of scholastic attainment within this 
group was rather narrow, considerably less 
than would be found within a single grade in 
the typical school system. In spite of this, 
both the Binet and the CSCT had substan- 


Table 3 


Range and Variability of an Orphanage Group on Two 
Tests of Intelligence and an Achievement Test 


Test Range Mean Sigma 
Binet (Land M) MA 140-76 107.36 13.87 
CSCT (Form B) 69-10 39.86 10.81 
Stanford Achievement 

(grade equivalent) 5.4-1.5 3:22 87 
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tial correlations with the Stanford scores. 
The Binet correlation was .623 and the CSCT 
correlation was .542. Since the Binet MAs 
and the CSCT were not highly correlated 
with each other (.349), a multiple r between 
these two and the Stanford Achievement was 
computed and was found to be .713. While 
the Binet was slightly more successful than 
the CSCT in predicting Stanford Achieve- 
ment scores, it should be noted that the 
Binet scores involved were averages of two 
forms, requiring a minimum testing time of 
two hours for each child, while the CSCT 
required about fifteen minutes for each child. 
Relationship of test scores to IQ gains in 
therapy. One other set of correlations may 
have particular interest for clinicians. As part 
of a larger experiment designed to increase 
IQs, 55 of these orphanage children with be- 
low-average IQs were exposed to an 18-month 
program of group play therapy, with 4 chil- 
dren in each group, and of enriched cultural 
opportunities. Both L and M of the Binet 
were given prior to and again at the conclu- 
sion of therapy. The range of IQ gains was 
not spectacular, from — 3.5 to + 17, with a 
mean of + 8.26 and an SD of 4.15. There 
was no relationship (.014) between the origi- 
nal IQ level and the amount of gain. How- 
ever, the original MA level correlated .172 
with the IQ gains and the CSCT scores cor- 
related .295 with these gains. These 7s are 
significant at the .11 and the .02 levels, re- 
spectively. If other corroboration of this find- 
2 etter hers A = potentially impor- 
ich can help 
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to predict the gains of retarded children from 
therapy is worth knowing about. 


Summary 


A method of testing “effective intelligence” 
by an unstructured oral sentence-completit 
technique (Copple Sentence Completion Test) 
has been described. A median interscorer te 
liability of .97 was found in an idea 
involving 10 scorers, and in other, eons 
projects, the results were comparable. Sp te 
half reliabilities for three studies reported in 
the present paper were .94, .95, and .93. J 

Three approaches to the test’s validity wet 
reported: : 

1. CSCT scores compared favorably with 
Binet and Goodenough mental ages 17 their 
correlation with chronological age. i 

2. CSCT scores compared favorably w! n 
Binet mental ages in predicting Stanfor 
Achievement Test scores. wi 

3. CSCT scores were significantly pies 
to IQ gains subsequently made by a group 
of retarded children undergoing play therapy: 


Received November 1, 1955. 
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A Note on Porteus Maze and Wechsler-Bellevue 


Antisocial Behavior’ 


Kenneth Purcell * 


Mental Hygiene Consultation Service, Fort Dix, New Jersey 


As part of a study on antisocial behavior 
and some of its personality correlates, data 
~ Were collected on Porteus Maze and short- 
form Wechsler-Bellevue performance. Previ- 
ne Studies (1, 2, 6, 9), using the qualitative 
oe for scoring the Maze Test described 
pe Porteus (5), have consistently reflected 
in erences between delinquents and nonde- 
= he Nevertheless, it seemed worth while 
vistin. ude the Maze Test in the present in- 
Allen one mainly because the type of popu- 
tie differed in important respects from 
er i Populations studied. Each of the for- 
alize ioe had compared institution- 
Presun elinquents with noninstitutionalized, 
Romane normal nondelinquent youths. T he 
of noni ‘on employed in this study consisted 
i or tutionalized young male adults, all 
clinic rs were referred to a mental hygiene 
has iea psychiatric problems. Porteus (7) 
Tes Pa evidence to show that the Maze 
Jilm a illy predicts general social ad- 
i is and adaptation. The question posed 
Maze co concerns the capacity of the 
guish est, qualitatively scored, to distin- 
P Prima poor social adjustment characterized 
types a by antisocial behavior from other 
Hunt Poor social adjustment. j 
Ports = French (3), in one of their re- 
Scale, fo the CVS abbreviated intelligence 
discipli und a tendency for psychopaths and 
hension it cases to score lower on Compre- 
OWwey an on Similarities and Vocabulary. 
er, the differences found were not sta- 


` 


A 
| 


hi 
n wishes to express his appreciation to 
Eel, ang De” Marvin Greenstein, Maurice Kou- 
°F this st r. Philip Kubzansky who collected data 
h ? Now ‘Udy and assisted in its statistical evaluation. 
at the University of Kentucky. 


tistically significant. It is suggested by the 
authors that this may well have been be- 
cause of inadequate criteria for defining a 
psychopathic population. Since the groups 
used in this study were reliably separated 
along the dimension of antisocial behavior, 
a further examination of CVS results seemed 
appropriate. In addition, on the basis of our 
experience at this clinic, it was felt that the 
Block Design subtest generally offered the 
most valid estimate of intellectual capacity 
among antisocial subjects. This appeared to 
be because negativism and resistance were 
minimal and interest maximal for this sub- 
test which Wechsler (8) reports as having 
one of the highest correlations with Full Scale 
IQ of all subtests (.73). 


Method 


A total of 56 male Army trainees between 
the ages of 17 and 26 with a mean age of 20 
were used as Ss for this experiment. All were 
psychiatric referrals to the mental hygiene 
clinic for whom psychological testing was 
requested. The only patients excluded were 
those suffering from organic brain damage or 
those diagnosed as psychotic. 

Tt was the intent of this study to relate 
psychological test results to overt behavior. 
Therefore, each S was rated on manifest anti- 
social behavior trends on the basis of social 
history data routinely obtained by one of the 
psychiatric social work specialists. Both mili- 
tary and civilian data were used in making 
this evaluation. Originally two raters inde- 
pendently judged the degree of antisocial be- 
havior on a seven-point scale with a reli- 
ability of .91 being obtained. This scale was 
later consolidated into a three-point scale to 
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Table 1 


alysis of Variance of Qualitativ ‘ores O! iffering in Antisocial Behavior 
Analysis of Vari f Qualitative Maze Scores of Three Groups Differing in Antisocial 
An: 


Group Mean* Variance F p 
.05 
Group I 30.38 Between groups 3,543.97 3.39 
Group II 42.94 Within groups 1,044.15 
Group III 58.57 


* Ns = 24, 18, and 14 for Groups I, II, and III respectively. 


t Between groups df = 2; Within groups df = 54. 


secure an adequate number of Ss for each 
category. Group I, the non-antisocial group, 
was composed of Ss whose overt aggressive 
behavior was minimal with no record of 
military or civilian disciplinary infractions. 
Group II, the intermediate group, consisted 
of Ss who may have been in fights with mod- 
erate frequency and whose record was marked 
by some school truancy, perhaps minor in- 
fractions of the law, and AWOL from the 
military. Group III, the antisocial group, 
consisted of Ss with an extensive pattern of 
delinquency including some criminal actions 


such as assault, rape, burglary, dope ped- 
dling, etc. 


The three group 


S were compared on quali- 
tative Maze Test 


scores and on the four 
Wechsler-Bellevue subtests noted above. In 


each case these measures were administered 
as part of a battery of clinical tests, 


Results and Discussion 
Analysis of variance 


ze in differentiating be- 
tween these two groups in the present study. 
First, the range of Ss was marked by more 
continuity with respect to antisocial behavior 
than was true in other investigations. The 
presence of a group intermediate between the 
extreme antisocial and non-antisocial groups 
created additional overlap of scores. Second, 


the number of Ss used in this study, Sa 
larly if one considers only the two pa 
groups, was considerably smaller than S if 
reported by other authors (1, 2, 5, 6, i eo 
similar differences were obtained with be 
Ns, the significance level would, of course, 
higher. 

Tt will be remembered that Group a= 
were also psychiatric referrals, the “en me) 
jority of whom had manifested some Tn, 
social maladjustment in the Army ie 
They may have been seclusive, overd ans 
ent, easily frightened by authority or that 
deficient in almost any respect except aa 
none of these Ss were aggressively il ñ 
in their overt behavior. Since the Q = ge a 
these Ss were only slightly higher, aa 
relative basis not at all higher than te 
Scores of normal controls used in ritative 
studies, it is apparent that the Ta Pre 
Maze Test tends to be sensitive ane sects 
tain types of social maladjustment. ai 
to be maladjustment marked by ee this 
ing impulsivity that is singled out ably 
qualitative analysis. Impulsivity is ah For 
the essential ingredient for high Q i Sg a5 
example, one of the severely ona d per- 
a shrewd, calculating relatively contro A esi 
son whose record reflected many 0 eve 
characteristics, He had been arrested 0 d to 
merous occasions but always cai z0 
elude conviction. His Ọ score of 5 manie 
the lowest for all Ss. In his behaviora ched, 
the tester noted that S was calm, oa (5 
and obviously out to demonstrate that 
could easily master the situation. id 2 

Since several authors (1, 7) have oe 
small but significant correlation er 
score and intelligence, the intellectual om 
must be measured and accounted for in § tual 
way. The task of estimating the intellec 
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Capacity of antisocial Ss is difficult since their 
test Performance is so colored by uncoopera- 
tive, negative attitudes. This was a particu- 
larly important problem in this study, as 
many of the Ss were actively engaged in in- 
tense rebellion against any form of military 
authority. 

Table 2 presents the results of the analysis 
of variance of the Wechsler-Bellevue data. 
The differences between the means of the 
three groups are significant for Prorated IQ, 
Similarities, Vocabulary, and Comprehension 
Scores with antisocial Ss achieving the lowest 
scores in each instance. By contrast, the dif- 
ferences found in Block Design means do not 
even approach significance. The reasons for 
this finding are at least twofold. First, almost 
every antisocial S had been an habitual tru- 
a and had left school much earlier than the 
een antisocial Ss. The benefits of educational 
Xperience on such tests as Vocabulary or 
the Prehension were lost to these Ss. Second, 
mince interaction required by the verbal 
altar Teproduces former unpleasant school 
fis | lons and creates many more opportuni- 
Be or the arousal of authority conflicts than 

“Ws during administration of the Block 


Design test. During the latter, S may focus 
his attention on impersonal objects without 
the necessity of replying directly to the ex- 
aminer. Antisocial individuals seem to find it 
less necessary to assert their rebellious non- 
conformity in this more oblique relationship 
with the examiner. 

Turning briefly to a comparison of Com- 
prehension scores with those of Similarities 
and Vocabulary, we find, from an inspection 
of means and significance levels indicated in 
Table 2, the same tendency for antisocial Ss 
to score relatively lower on Comprehension, 
as was noted by Hunt and French (3). Al- 
though the differences between these subtests 
do not attain statistical significance, the 
qualitative variation between the groups in 
their responses to certain items of the Com- 
prehension test seems worthy of note. The 
answers of antisocial Ss to the questions on 
the envelope, bad company, taxes, and law, 
commonly contained antisocial content in 
some part of the response, although giving 
credit to the response might be required un- 
der the rules of scoring. Perhaps a revised 
scoring scheme or the remodeling of Com- 
prehension to encourage antisocial answers in 


Table 2 


Analysis of Variance of Wechsler-Bellevue Subtest Scores of Three Groups Differing in Antisocial Behavior 


Variable Mean* Variance F p 
Prorated I 
Group X 103.45 Between groups 3,296.47 9.36 .001 
Group IT 96.26 Within groups 352.26 
DEDIT 7635 
cK Desi 
Group : 9.62 Between groups 8.14 65 Non. 
Group II 8.94 Within groups 12.40 signi 
Group Tr 8.28 
mprehensi 
Groupl 40.22 ciween goi 113.06 10.77 001 
Group II 8.39 Within groups 10. 
Woe IL 5.00 
cabular 
Group A 9.34 Between groups E 5.22 O1 
Group IT 8.93 Within groups 9. 
croup TIT 6.56 
ilarities 
Group I 11.00 Between groups se 7.47 01 
Group II 9.81 Within groups 13.6 
Group TIL 6.83 


* 

ie z 

t Betweet 18, and 14 for Groups I, II, and III, respectively. 
en groups df = 2; Within groups df = 54. 
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p P bs , K ae . . ifi- 
accordance with the suggestion of Hunt and lary, and Similarities scores differed signi 
along the dimension of antisocial trends. offered in terms of the more remote oe 
y > subject relationship during Block Design a 

ministration as compared with the other three 
subtests. 


Summary 


One of the questions with which this study 
was concerned was whether the Porteus Maze Received December 20, 1955. 


test, qualitatively scored, could successfully 
distinguish between poor social adjustment 
marked by antisocial behavior and various 
other types of poor social adjustment. The 
second aspect of the study dealt with scatter 
scores among the Comprehension, Vocabulary, 
Similarities, and Block Design subtests of the 
Wechsler-Bellevue Intelligence Scale. 
Fifty-six young adult Army trainees, all of 
them referrals to the Mental Hygiene Con- 
sultation Service, serve as Ss. The Ss were 
divided into three groups on the basis of wide 
variations in overt antisocial behavior. 
Qualitative Maze Test scores differentiated 
significantly between three groups, the most 
antisocial group having the largest Q score. 
It appeared that impulsivit 


! i y was the basic 
personality variable measured by qualitative 
evaluation. 


Finally, our impression that B 
performance would be the subte. 
paired by antisocial tendencies w. 
The results showed no significant differences 
between the three groups in Block Design 
scores, although the Comprehension, Vocabu- 


lock Design 
st least im- 
as confirmed. 


French (3) would improve its discrimination cantly. An explanation for these findings is | 


f 
A e o0 
. Wright, Clare. The qualitative performant 
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T there has been much published specu- 
Sa and theorizing about the etiology of 
hay, ering (e.g., 1, 8), until recently there 

the , been relatively few empirical studies of 

em ig of this fairly common clinical prob- 
A (12) arley (2), Johnson (9), LaFallotte 
temi t and Moncur (13, 14) have all at- 

See to investigate the circumstances sur- 

inten ing the development of stuttering by 

tine ce interviewing the parents of stut- 

a cee children, The present study represents 
investi validation and extension of these prior 
Ure cone and includes an objective meas- 

Multi — adjustment, the Minnesota 
'| is Phasic Personality Inventory (MMPI). 
i e A reports the MMPI ane! qie 

Where Co findings are reported etse 
l. for os ‘inn has been used in a similar way 

aton ee parental adjustment in its re- 
| askie child behavior by Williams (18) in 
| Cerebral. of families in which there was a 

in sCtal-palsied child, and by Grossman (7) 

is an ation to stuttering. The present study 
\ More extension of this method to a larger, 

Carefully selected set of parents. 


Subjects and Procedures 


A i . *, 
A the amiy was considered for inclusion 1m 
uttering or experimental group if one 


aT . 
Lo ig i research was supported by a grant from the 
Paul, yppend Maud Hill Family Foundation of St. 
A Wenjigtitmesota. The authors wish to thank Dr. 


de 
Brant, ll Johnson, the principal recipient of the 


Execut for his help and encouragement during the 


tio: Š 
anuscript the research and the preparation of this 


or both of the parents regarded the child as 
a stutterer and if the duration of the stutter- 
ing was reported as less than 36 months. A 
family was considered in the nonstuttering or 
control group if the child had never been re- 
garded as a stutterer by either of the parents. 
Each experimental family was matched to a 
control family on the basis of the child’s age 
and sex as well as the socioeconomic status 
of the parents. Only essentially physically 
normal, white children were included in the 
study. The experimental subjects (Ss) had 
been referred to the experimenters by speech 
therapists, physicians, etc., while the control 
Ss were secured by appeals for volunteers to 
PTA’s, church groups, etc. The complete de- 
tails of subject selection are available else- 
where (10). 

The routine administration of the booklet 
form of the MMPI was part of the standard 
interview procedure (see 10) that was fol- 
lowed with each parent who had agreed to 
participate in the over-all study. Usually one 
parent took the test while the other parent 
was being interviewed. If the tests were not 
completed before the interviewer was ready 
to leave, arrangements were made to have the 
booklets and answer sheets picked up at some 
later time. 

While it had been planned to secure an 
MMPI profile from each parent, this goal 
was not realized due to a number of uncon- 
trollable factors such as lack of time, refusal 
to cooperate, etc. MMPI profiles, however, 
were obtained from 224 of the 300 experi- 
mental parents and from 223 of the 300 con- 
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trol parents. An inspection of the other data 
did not suggest that those parents who had 
failed to complete the MMPI were different 
in any obvious ways from those parents for 
whom profiles were secured. 

All MMPI answer sheets were hand scored 
by the interviewers for the usual four va- 
lidity and nine clinical scales as well as four 
special scales that were thought, on an a 
priori basis, to represent variables important 
to the onset of stuttering. These four special 
scales were the Taylor Manifest Anxiety Scale 
(A) (15), the Achievement Scale (Ac) (5), 
the Dominance Scale (Do) (6), and the 
Status Scale (St) (4). All profiles were also 
coded into Welsh’s high-point coding system 
(16). For ease in tabulation and statistical 
analysis, the scores on the 17 scales as well 
as the high-point codes were then coded into 
a predetermined coding system and punched 
on standard IBM punch cards. 


Results 


Four groups of 100 profiles each, experi- 
mental mothers, experimental fathers, con- 
trol mothers, and control fathers were se- 
lected from the 447 available MMPI profiles 
by excluding the 47 profiles whose validity 
scale scores suggested a significant degree of 
dissimulation. The cutting scores for exclu- 
sion were: L-scale raw score of 7 or higher 
or F-scale raw score of 17 or higher or K- 
scale raw score of 28 or greater, The num- 
bers of cases excluded on the basis of these 
criteria were 17, 22, and 8, respectively; 
there were no obvious differences between the 


control and experimental parents with respect 
to these validity criteria. 


The means and st: 
17 MMPI scales f 


For ease 
scores in Table 1 are 
on the original distri 
than the coded scor 
ported values are, c 
rather than exact; 
ever, were based up 
score values. 


A prior comparison of the means of the 


onsequently, approximate 
all statistical tests, how- 
on the more exact coded 
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Table 1 


Means and SDs* of the MMPI Scales for the Two 
Groups and the Significance Levels of the 
Differences Between the Means 
(N = 200 in each cell) 


Experimental Control 
parents parents 

Scalet Mean SD Mean SD pt 
? 6.5 7.9 58 4.6 ns 
L 3.3 1.9 36 18 >a 
F 3.2 2.5 28 18 a 
K 15.5 5.2 169 48 m 
Hs 51.6 8.7 53.0 74 : 
D 53.9 10.3 524 92 E 
Hy 55.5 7.9 56.1 7.7 z 
Pd 53.2 9.6 54.8 9.0 23 
MfS 52.5 101 52.7 10.1 za 
Pa 52.8 78 52.3 68 he 
Pt 53.0 8.6 51.9 7.7 = 
Se 51.7 9.0 52.2 78 = 
Ma 51.9 10.1 51.2 9.1 ii 
A 14.3 7.6 11.8 69 so 
Ac 16.9 2.9 16.8 2.6 a1 
Do 17.3 3.3 188 3.3 ore 
St 214 3.9 22.5 4.0 


» derived from 
*These values are approximate as they were derive ei 
the coded scores, j, MÍ. i 
+The sae Gn the clinical scales (Hs, D, Hy, Pa, MI sed 
Pt, Sc, and Ma) are in T-score units; all the other? are ee appro 
in raw score units. K-scale corrections included v sien 
riate. e ifican' 
Pre The tests for mean‘differences ae-well:sié ithe r slam precise 
levels for these differences were based upon t ad in this table. 
coded score values rather than the values reported ar > 01) 
§ Both groups of fathers were significantly sil es no signifi- 
than both groups of mothers; there were, howe? Hherers: 
cant differences between the stutterers and nonstu 


experimental mothers with the experimental 
fathers and of the control mothers with sex 
control fathers gave no evidence of mr om 
differences in the scores and the data po 
the two sexes were combined. The only cale 
ception to this finding was for the M eat 
on which both groups of fathers had Shall 
cantly higher (p < .01) mean T scores ver; 
both groups of mothers; there were, = eri- 
no significant differences between the wer 
mental and control groups and the ae 
therefore combined in this case as well. dif- 

There were only three significant pena the 
ferences between the experimental an The 
control parents on the 17 MMPI scales. ean 
control parents had significantly higher mes 
scores on the K and Dominance (D o) es 
($ <.05, p <.01, respectively) while the er 
perimental parents had a significantly Þig 
mean score on the Anxiety (4) scale 


a 
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i Table 2 
Relative Frequencies of the Initial Scale in the High-Point Code for Each Group 
MMPI Clinical Scales* 

Group Hs D Hy Pd Mf Pa Pt Sc Ma Total 
Experimental mothers 4 13 18 12 15 12 8 6 12 100 
Experimental fathers 5 17 16 8 23 4 5 4 18 100 

Subtotal 9 30 34 20 38 16 13 10 30 200 
Control mothers 3 18 27 22 6 7 f 5 5 100 
Control fathers 1 10 17 18 27 4 5 3 15 100 

Subtotal 4 28 44 40 33 11 12 8 20 200 
Grand total 13 58 78 60 71 27 25 18 50 400 


s i , r 5 
Only the nine clinical scales were used in this analysis. 


ae None of the other mean differences were 
‘Snificant at an acceptable level of confidence. 

he relative frequencies in the four groups 
cod 5 or the initial scale in the high-point 

€, that is, the clinical scale with the high- 
are “Score value in the individual profiles, 
i ntel in Table 2. The differences be- 
anal the obtained frequencies were then 
a tie by means of the chi-square test for 
differe Y-nine table. There were no significant 
trol aS between the experimental and con- 
cont athers, between the experimental and 

rol mothers, or between the experimental 
control parents combined over sex. There 


occurred relatively more frequently in the 
initial position in the male codes while the 
Pa and Sc scales were the more frequent ini- 
tial points in the female codes. 

The relative frequencies in the four groups 
of Ss of the secondary scale in the high-point 
code, that is, the clinical scale with the second 
highest T-score value in the individual pro- 
files, are presented in Table 3. The differences 
between the obtained frequencies were again 
analyzed by the means of the chi-square test 
for a two-by-nine table. Again there were 
no differences between the experimental and 
control fathers, the experimental and control 


=" OWever, significant differences between mothers, or between the total experimental 
© total male group and the total female and the total control group. Again there were 
Broup When the experimental and control significant differences between the total male 
Stoups are combined (p < .001). It may be group and the total female group when the 
Seen in Table 2 that the Mf and Ma scales experimental and control groups are com- 
Table 3 
Relative Frequencies of the Secondary Scale in the High-Point Code for Each Group 
MMPI Clinical Scales* 
Group Hs D Hy Pd Mf Pa Pi Sc Ma Total 
piberimental mothers 9 ii 21 12 6 14 12 9 = 100 
*Perimental fathers 4 ig 13 4 15 u 8 5 100 
ubtotal i 13 29 34 2% 2 235 2% 14 18 200 
Control m 13 B & 7 u 100 
oth 6 20 14 
ontrol fathers. 7 13 18 16 16 9 6 9 11 100 
Subtotal 4 19 38 30 29 2 A 16 2 200 
Grand total a a n 56 50 46 34 30 40 400 


* 
Ont ; i 
Y the nine clinical scales were used in this analysis. 
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bined (p < .02). It may be seen in Table 3 
that the D, Mj, and Ma scales occurred rela- 
tively more frequently in the secondary po- 
sition in the male codes while the Hs and Hy 
scales were the more frequent secondary 
scales in the female codes. 

The number of parents in the two groups 
with one or more T scores above 70 on the 
clinical scales (the usual cutting score) was 
then obtained in an effort to evaluate the rela- 
tive frequency of “severe disturbance” in the 
two groups. There were 47 persons with one 
or more T scores above 70 in the control 
group and 49 persons in the experimental 
group; by eliminating from consideration 
those cases where both parents in the family 
had scores above 70, these numbers were re- 
duced to 41 and 42, respectively. An inspec- 
tion of the high-point codes of those “severely 
disturbed” individuals did not reveal any dif- 
ferences between the experimental and con- 
trol groups although the sex differences that 
were discussed above (see Tables 2 and 3) 
were again present. 

In an attempt to evaluate the differences 
in the severity of stuttering as a function of 
the “abnormality” of the MMPI scores, the 
experimental group was then divided into two 
subgroups, those families in which one or 
both parents had one or more clinical scale 
T scores above 70 (the disturbed group) and 
those families in which neither parent had a 


clinical scale 7T score above 70 (the nondis- 


of the disturbed 
parents was 1.97 (SD = :97) while the mean 
rating for the children of the nondisturbed 
parents was 3.13 (SD = -71); the differences 
between these means 


Iowa Scale indicates normal, fluent speech 


while a rating of 3 indicates a relatively mild 
degree of stuttering.) 
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Discussion 


The most striking finding of this portion of f 
the total study was the failure to a 
any major differences between the parents o 

the stuttering and nonstuttering children. Al- 
though certain differences between the two 
groups of parents were statistically signin 
cant and psychologically provocative, 7 i 
over-all impression left by the results is mang 
whatever important differences exist berme 
these groups is not reflected in their MM 
scores. Certainly the small absolute differ- 
ences between the means and the large 
amount of overlap between the two eee 
tions of scores would prohibit the use oi a 
MMPI as an instrument for differentiating 
these groups in clinical work. ith 

These results are in essential agreement Mhe 
those of Grossman (7) who reported that ; r 
parents of stutterers gave more atypital a | 
pathological responses on the MMPI t rs 
the parents of nonstutterers on the F ere 
but did not differ on any of the other sca z 
Her results were obtained from older, ape 
chronic stutterers and her parent a be 
volved only an W of 42 each. It shoul iwo 
noted that the differences between her 
groups were small in absolute magnitude 2” 
Statistically unreliable. 

It is essential to note that not only are a? 
sets of parents very similar to each othe lso 
their mean MMPI profiles but they are aA 
very similar to the original standardiza. A \ 
group of Minnesota normals (17). The ry 
est clinical scale mean for either group = t is 
for the control parents on the Hy scale; from 
represents a deviation of only 0.6 SDs } tri- 
the expected score of a group of pyi ne P 
cally normal persons, that is, 50.0. The E 
est clinical scale mean for the erpen a 
group, who presumably should be O ese 
adjusted, is 55.5, also on the Hy scale. t 
of course, are the largest differences on er 
expected normal mean score and all the 0 te! 
obtained means are closer to the exper. 
value of 50.0. While some of these onan’ 
may be of statistical significance, they or- 
not, in all probability, psychologically imP™ 
tant. It is more reasonable to ascribe 5 
small differences to sampling factors er 
any “real” differences between the mun 
studied in the present investigation an 
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Standardization group. These differences cer- 
tainly are not evidence for regarding either 
the control or experimental groups of parents 
as psychiatrically abnormal or more malad- 
Justed than adult persons in general. 

The absence of abnormality in these mean 
Profiles is even more strikingly brought home 
When these profiles are compared with the 
mean profiles of various neurotic and psy- 
Chotic groups (17) and of college students 
(3, 17). Each of these latter groups have 
characteristic mean profiles with very marked 
Peaks and valleys differing greatly from the 

at mean profiles obtained from these par- 
ents. Such comparisons strongly support the 
Contention that these individuals are, for the 
oe Part, essentially normal persons who 

ier little, if at all, from the group of nor- 
es adult Minnesotans who comprised the 
d ndardization sample. These results inci- 

Ely, especially those with the control 
roe offer strong support for the continued 
witho the MMPI as a screening instrument 

Presumably normal adults. 

ile the present results offer no evidence 
Oncluding that these two groups of par- 
Ra are very different from each other or 
be r normal individuals generally, it should 
altho ned that 3 of the 17 mean differences, 
ERa the absolute differences were quite 
Comm Were significant and deserve further 

en On the K scale the control parents 
he S Was significantly higher than that of 
t at Derimenta] parents. This would indicate 
efe the control parents were somewhat more 

e ripe less likely to admit psychological 
es or problems, than the experimental 
asked These control parents had not been 
admit as had the experimental parents, to 
they A S part of the selection procedure a 
Certainly ee their children as deviant, an 

ight be expected to be less open 

more defensive in such a clinical situation. 

the ; finding that the control group mean on 
higher p mance (Do) scale was significantly 
Suggests han that of the experimental group, 
Person mg greater dominance in face-to-face 
erpre  ätionships, is rather difficult to in- 
Concly „and fit into the other findings and 
Little Sions about the onset of stuttering. 
Useful 1s known about the interpretation and 
ness of the Do scale as it is a recent 


for ¢ 
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addition to the MMPI scales and perhaps any 
more elaborate interpretation of this result 
should be postponed until additional informa- 
tion about the Do scale is available. 

The experimental parents were significantly 
higher on the Anxiety (A) scale: than were 
the control parents. Certainly the admission 
of greater tension and anxiety on the part of 
the stutterers’ parents may be regarded as an 
important finding, but great care should be 
exercised in relating this finding to the onset 
of stuttering. The heightened anxiety on the 
part of the experimental parents may be an 
important etiological factor in the develop- 
ment of stuttering, or may be a subsequent 
reaction by these experimental parents to the 
development of stuttering by their children. 
The present results do not permit a resolu- 
tion of these alternative interpretations. 

Perhaps the best evidence that the experi- 
mental group of parents was essentially nor- 
mal from a psychiatric point of view was the 
finding that the “deviant” group of experi- 
mental parents, those with one or more T 
scores above 70, had children with little or 
no stuttering as compared with the nondevi- 
ant experimental group. On the other hand, 
the MMPI profiles of the parents of the more 
severe stutterers were almost uniformly within 
normal limits and gave no indication of severe 
psychological pathology of any sort. It may 
be that these deviant parents volunteered for 
participation not so much because they were 
concerned with nonfluencies in their chil- 
drens’ speech, but rather with their own prob- 
lems; they may have regarded participation 
in the experiment as one way of receiving 
help with these more general problems, rather 
than an opportunity to discuss their chil- 
drens’ speech. Such an interpretation would 
indicate a need for caution on the part of the 
speech therapist when he does find a stut- 
terer’s parent with a deviant MMPI profile. 

The MMPI results are in general agree- 
ment with those of the over-all investigation 
(10) in that they do not support the notion 
that the parents of stutterers are very differ- 
ent in their behavior and attitudes from the 
parents of nonstutterers. Rather these results 
support the suggestion that those group dif- 
ferences that are important in the etiology of 
stuttering are rather limited and probably 
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quite specific to the speech situation and the 
stuttering phenomenon. 


Summary 


The Minnesota Multiphasic Personality In- 
ventory (MMPI) was administered to 447 
parents participating in an interview study 
of the onset of stuttering in an attempt to 
compare the relative psychological adjust- 
ment and personality characteristics of par- 
ents of stuttering children (experimental 
group) and parents of nonstuttering children 
(control group). Four groups of 100 MMPI 
records, experimental fathers, experimental 
mothers, control fathers, control mothers, 
were selected by excluding those records 
whose validity scores suggested dissimulation. 

There were only three significant mean dif- 
ferences between the experimental and con- 
trol parents on the 17 MMPI scales used in 
this study; the control parents had signifi- 
cantly higher mean scores on the K and Do 
scales while the experimental parents had a 
significantly higher mean score on the A 
scale. A comparison of the high-point codes 
of the experimental and control groups re- 
vealed no significant differences between these 
two groups. There were no significant differ- 
ences in the number of parents in the two 
groups with one or more clinical scale T 
Scores above 70, the usual cutting score in- 
dicating some degree of Psychological pa- 
thology. The children of the experimental 
Parents with T scores above 70 were shown 
ea ae Sy ee ceil 
a e stuttering than the remainder of 

perimental group children, 

These results were interpreted as indicating 
that the performances of these two groups 
were not significantly different, nor was the 
performance of either group significantly dif- 
ferent from the expected performance of psy- 
chiatrically normal persons. There was no 
evidence that the etiology of stuttering is 
rooted in gross psychological pathology of the 
stutterer’s parents but rather the results are 
to be interpreted as supporting the notion 
that such attitudes and adjustments of the 
parents as may be involved in the etiology of 
stuttering are probably limited and specific 
to the speech situation. 
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Response Bias and the MMPI 
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m S recen article Berg (2) has proposed 
This h © terms “the deviation hypothesis.” 
Men is stated as follows: “Deviant 
those ni patterns tend to be general; hence 
Sigulficant ten behavior patterns which are 
as sym 3 for abnormality and thus regarded 
ant = oms, are associated with other devi- 
cal i awe patterns which are in noncriti- 
regarded of behavior and which are not 
tion” (2 as symptoms of personality aberra- 
fined > P. 62). Deviant responses are de- 
SPonse: 3 those which differ from modal re- 
given d OF criterion group responses at a 
est | of significance. Berg states, To 
ary onl pothesis stated above, it is neces- 
€spons ly to identify the common or modal 
Patterns, to any suitable series of stimulus 
response and predict that those subjects whose 
Modal es rather consistently go against the 
ae ences will be deviant in the sense 
With a iting symptom patterns associated 
Cotes gre states. It should be noted that 
as im of stimulus patterns is not regarded 
t Portant” (2, pp. 62-63). 
Barnes (Study pertinent to this hypothesis 
(PRT (1) used the Perceptual Reaction Test 
Tespons as an instrument for eliciting deviant 
Sixty al patterns. The PRT is a series of 
Mpas stract designs made with ruler and 
SPond b to which the S is required to re- 
tions; te marking one of the following OP- 
0 isthe much, like slightly, dislike slightly, 
SPonse much. By the use of deviant Te 
Stryc, Patterns alone it was possible to con- 
opathon. les for certain categories of psy- 
that ewe In this study it was found 
bet atie groups differed in their option 
Mer ces from normal groups in that the 
the no generally preferred like much while 
Slightly a groups tended to prefer dislike 
- A set to choose dislike much tended 


Si 
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to be characteristic of character disorders in 
contrast to the performance of psychotic and 
normal groups. Cottle and Powell (4) dem- 
onstrated that answering all of the MMPI 
items “true” produced a profile with high 
scores on the psychotic triad while scoring all 
items “false” produced high scores on the 
neurotic triad. Berg cites these studies as evi- 
dence suggesting that, “a marked tendency to 
say ‘yes’ or ‘agree,’ etc., in personality inven- 
tories should be associated with psychotic 
states while ‘no’ or ‘disagree’ option choices 
should be associated with neurotic states” 
(2, p. 66). 

There are evidently two parts to the devia- 
tion hypothesis as stated by Berg. The first 
and major part concerns merely the associa- 
tion of deviant response patterns on psycho- 
logical tests with deviant behavior patterns. 
Tt asserts a general relationship between devi- 
ant test behavior and the deviant behavior of 
psychopathological conditions. This hypothe- 
sis draws together a variety of behavioral 
phenomena and makes explicit an assumption 
which has been implicit in much prior work. 
Few would argue that a “blood response” on 
the Rorschach was deviant behavior in a so- 
cially critical area, while few would disagree 
that strangling one’s mother is. Nevertheless, 
a tenuous relationship has been assumed be- 
tween “acting out” behavior and the socially 
nonsignificant response of “blood.” The sec- 
ond and minor portion of the hypothesis con- 
cerns the directionality of such deviant re- 
sponse patterns as have been observed. This 
portion of the hypothesis asserts, in effect, 
that different types of response sets or biases 
are associated with different types of deviant 
behavior. 

Individual record forms of the MMPI are 
a convenient source of material for testing 
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certain deductions from the deviation hy- 
pothesis since the scoring system Provides 
that only those items which are answered in 
the infrequent direction are recorded (6, p. 
_ 8). These items are, by Berg’s definition, 
deviant responses. Thus, if content of stimu- 
lus patterns is not important, it would be in- 
ferred that the number of deviant responses, 
.ie., Xs, on the record form of the MMPI 
should be as effective a measure of psycho- 
pathology in general as the profile itself. A 
scale of the MMPI which specifically pur- 
Ports to measure a psychotic reaction is the 
Sc scale. This scale, then, should correlate 
significantly with the total number of deviant 
responses. A preliminary check with grouped 
data „revealed that the number of Xs corre- 
lated .92 with the Sc scale for a sample of 24 
male veterans in a neuropsychiatric hospital. 
The correlation to be expected from the num- 
ber of common elements is -38 as calculated 
from a formula given by McNemar (8, p. 
118). This limited confirmation suggested a 
more systematic exploration, 


large number of stu 
the 


By inference from the 
the total number of 
correlate 


Symptom Patterns 
States” 


resulting from 
modal response 
most highly with 
triad while respon 
response jg 
highly with 

ince these t 
choices are 
sponse sets, 


responding 
is “false” 
the scales 
ding “false” 
“true” should ; 
the scales of the 
endencies to prefer certain option 
ee as being different re- 
e tendency to answer atypj 
true should not be correlat eee 


ed with t i 
ency to answer atypically false, iki 


neurotic triad, 


Procedure 
Subjects. The Ss were 40 mal 


one reason or another had be 
MMPI by the author. 3 


very heterogeneous group 


es who, for 
n given the 
These Ss were a 


including Psychotic 
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outpatients, neurotics, vocational counselh 
cases, and court referrals. Variances on ‘ie 
MMPI clinical scales are, therefore, ee 
less larger than from a random sample o oa 
general population. It should also be bp “ 
that they were not representative 0 fe 
homogeneous clinical grouping. The ei 
was probably representative of those a RI 
come to the attention of a psychologis 
rivate practice. T 
5 Method. Pearson zs were machine E 
lated for correlations of each of the ie E 
scales and three validating scales with, first, 
total number of deviant responses, AF F 
number of deviant responses resulting m 
answering items false, and third, numan 
deviant responses resulting from answers 
items true. 


Results 


Results are summarized in Table 1. It é : 
be noted that the differences in relative ee 
of correlation coefficients on the neurone 
and psychotic triad are all in the predi at 
direction, a result significant, without r 
to magnitude, at less than a 2 per cent toaa 
of confidence as calculated by the sign aes 
The correlation between the deviant resp ie 
obtained by answering false and those the 
tained by answering true is less than by- 
standard error and we may accept the 


Table 1 onses 
Correlations of MMPI Scales with Deviant Resp 
vt 
Total Deviant an 
number of responses pren 
deviant answered "false 
Scale responses true 7 
ee e 
L —.09 —.24 ia 
F 74 66 ‘06 
K —.60 —.69 ‘56 
Hs 66 52 73 
D ‘56 34 ‘59 
Hy 12 —.09 28 
Pa 7 68 21 
Mf 32 28 37 
Pa 60 52 31 
Pt 87 84 36 
Sc 93 90 21 
Ma 38 -50 i 
Dev. responses 
answered false it 
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pothesis of no correlation. Certainly the total 
number of deviant responses is significantly 
associated with the clinical scales. 


Discussion 


This study was designed to test certain de- 
ductions derived from the deviation hypothe- 
Sis and collateral research, not as a definitive 
test of the total hypothesis. Within this re- 
stricted frame of reference the deductions 
have been confirmed and this confirmation in- 
directly lends support to the hypothesis from 
Which they were derived. 

ë The deviation hypothesis does not take into 
°nsideration the matter of item content. If a 
pester for a response option exists in a 
cn Population, deviating from this pref- 
ene should add some increment to an in- 
stud or of psychopathology. In the present 
non y ioe find evidence of such a phenome- 
items Vith no attention given to particular 
ak or their content, a mere summing of 
tenga. e responses bears a striking rela- 
Scales Ìp to certain of the MMPI clinical 
» as shown in Table 1. 

ne interesting implication of this portion 
Mise hypothesis is that it would provide a 


tical rationale for the behavior of the 
Scale 


Structeg 
answered 
s 


of the MMPI. This scale was con- 
rom items which were very rarely 
in the scored direction by normal 
ve n inspection these items seem to 
nality o Psychological coherence or commu- 
Scale RA et it has been observed that the F- 
tions Core is elevated in personality aberra- 
dubbed > 9). The F scale has even been 
“the > Somewhat informally and inelegantly 
Pothesis Pall scale.” * The deviation hy- 

Scale Would predict just such a result from 
dict p S° Constructed. It would, in fact, pre- 
Score, at even a random selection of items 
result, m this manner would give a similar 


it th Tespect to the direction of deviation, 
in wee oe deviating by atypically answer- 
dicative 1S associated with MMPI scales in- 
While ee a psychotic type of pathology 
ateq y aly answering false is associ- 

ith scales indicative of a neurotic re- 


lig 
this lab eoy Serves correctly the author first heard 
el used by Dr. E. S. Bordin. 
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action. It may be argued that this result is 
obtained simply because the scales of the 
neurotic triad are more heavily weighted with 
items scored when they are answered false 
and those of the psychotic scales more 
heavily weighted with items scored when an- 
swered true. Although it is a fact that a de- 
gree of such differential weighting exists, such 
an “explanation” is circular in that it fails to 
explain the origin of such a weighting. Why 
did it happen, in the empirical derivation of 
the scales, that more items were found to 
discriminate between certain clinical groups 
and normals when answered in just these di- 
rections? In view of the results obtained in 
this study and the other studies cited, an an- 
swer in terms of chance distribution of item 
content seems untenable. It seems increas- 
ingly probable that response sets play a 
much more important role in personality test- 
ing than has been suspected. 


Summary 


A study was undertaken to test some de- 
ductions concerning the MMPI derived from 
Berg’s deviation hypothesis (2). According to 
this hypothesis Ss whose responses consist- 
ently go against modal preferences should 
display symptom patterns of abnormality. 
Further, this hypothesis would predict that 
atypically responding true should be asso- 
ciated with psychotic states while atypically 
answering false should be associated with neu- 
rotic conditions. These two tendencies should 
be relatively unrelated to one another. 

Since the record form of the individual 
MMPI provides that only items answered 
in the infrequent direction are entered, it is 
possible to count the number of deviant re- 
sponses, to separate these into those ob- 
tained by answering atypically false and 
atypically true, and to correlate these scores 
with the scales of the MMPI. These opera- 
tions were performed and it was found, as 
predicted, that the total number of deviant 
responses correlated highly with the clinical 
scales, that the tendency to answer atypi- 
cally true was more highly correlated with the 
scales of the psychotic triad while the tend- 
ency to answer atypically false was more 
highly correlated with the neurotic triad, and 
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hat the two tendencies were not significantly 
orrelated. 

It is concluded that the deviation hypothe- 
sis has received some indirect confirmation 
both with respect to its general statement 
and with respect to direction of deviation. 
Also, it is concluded that response sets of 
this type play a larger part in personality 
testing than has been suspected. 
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Delaying Capacity, Fantasy, and Planning Ability: 


A Factorial Study 


of Some Basic Ego Functions 


Jerome L. Singer, Harold Wilensky, and Vivian G. McCraven 
Franklin D. Roosevelt VA Hospital, Montrose, N. Y4 


aha Pong ability to delay gratification 
desired mea a direct motor approach to a 
ture in paer appears to be a necessary fea- 
in hüma e development of an identifiable self 
with oat ining Intimately associated 
resort io “ite! ing capacity is the ability to 
tal actio t ought or ideation as “experimen 
of tem n” (8) ina behavioral medium freed 
as agi and spatial boundaries. As early 
Cal linka reud (7) had suggested a theoreti- 
and thi geut delay and thought development 
ture at relationship became a pivotal fea- 
and, lat his concept of the reality principle 
empiric a the ego. Similar theoretical and 
inhibitio associations of thought and motor 
y Psy or delay have also been described 
elds -EN and psychiatrists in diverse 
attention | 19, 21, 30). With the increased 
ego ae by psychoanalytic theorists to 
ning, s or and to functions such as plan- 
(9, 14 To esizing, and controlling motility 
Psychoan ‘3 the possibility of integrating the 
9 S ytic hypotheses with the concepts 
between ria, led involving the theoretical link 
ior emer antasy, language, and motor behav- 
Study an more clearly (22). The present 
i) Snare a further step in 4 program 
ionshi; ch aimed at investigating some rela- 
ture, ps of thought and delay in €80 struc- 
T z 
ae Eei approach to this problem has 
study of A the medium of an intensive 
On the R, e Human Movement response (M) 
orschach inkblots and its behavioral 


ph 
pra roam ee are indebted to Drs. John F. Winne 
he statisti ohen who gave valuable assistance in 
thology st “ analysis of the data and to the psy- 
aff, trainees, and ward personnel who par- 


“pated j 
in 
some of the evaluative procedures. 


correlates. Rorschach (20) pointed out that 
those persons who saw numerous human fig- 
ures in motion on the blots tended to be 
inhibited in their own motor activity and 
given to considerable imagination or fantasy 
“movements in the mind’s eye.” In effect, 
therefore, Rorschach’s observations, and tase 
of subsequent Rorschach workers (16, 18, 21) 
suggest that the M response may serve as a 
crude measure of delaying capacity and of 
imaginative tendencies which are basic ego- 
functions in Freud's formulation. The experi- 
mental work on the vicarious functioning of 
sensory and motor patterns carried out by 
Werner and Wapner and their colleagues is 
consistent with this approach and has car- 
ried it a step toward more precise formula- 
tion in perceptual theory (30, 31, 32). A 
number of studies in the present series have 
also supported Rorschach’s observations by 
that individuals whose Ror- 
schachs contain relatively more M responses 
are capable of greater motor inhibition in 
slow-writing tasks, move about less in a 
waiting-room situation, and tend to tell more 
imaginative stories to TAT pictures (14, 23, 
24). In the study to be presented here this 
work will be extended to include a large num- 
ber of tests and behavioral situations which 
presumably tap aspects of impulse control or 
delaying capacity, planfulness, and fantasy. 
The general problem raised is whether con- 
sistent individual patterns emerge along a 
dimension that links delaying capacity, fan- 
tasy, planning ability, and various measures 
of motility control. 

In approaching a concrete formulation of 
the general hypothesis a series of tests and 


behavioral indices were selected which, while 
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i issimilar, were expected to de- 

A a e factor. The 
R a general intelligence measure, 
employed as a control since it was felt A 
to determine the extent to whic! le 
e in question was related to intelli- 
ence. The Rorschach test was included, with 
omais M response in particular ex- 
pected to yield a high loading on a fantasy- 
motility factor. In order to evaluate the gen- 
erality of the Human Movement phenomenon 
and to control for total number of Rorschach 
responses, Barron’s Movement Threshold Ink- 
blots (1) were included. Another estimate of 
fantasy tendencies was obtained from stories 
told by the Ss to four Thematic Apperception 
Test pictures scored for “transcendence, i.e., 
introduction of characters, emotions, and 
temporal references which went beyond the 
mere description of the picture. Still another 
manifestation of fantasy tendencies charac- 
teristic of ego functioning might be an in- 
clination toward setting high goals. A meas- 
ure of level of aspiration was therefore in- 
cluded as well as a measure of sheer speed 


of performance in a simple motor task. The 
latter measure, however 


pected to show a si 


qualitative results į 
had suggested int 
ences in admissio: 
ing a failure exp 
ably interfered w 
A crude measur 
disturbance foll 


n a previous study (33) 
eresting individual differ- 
n of distress by Ss follow- 
erience which had measur- 
ith intellectual performance. 
e of admission or denial of 
owing failure was therefore 
included in the test battery with the hypothe- 
sis that it would carry an appreciable loading 
on a fantasy factor. A somewhat similar ra- 
tionale led to the inclusion of a technique 
which was felt to measure compliance with 
the examiner’s wishes and persistence in a 
routine task to please another Person despite 
psychological satiation. F: inally, some attempt 
was made to obtain a measure of planning 
ability or foresight since this seems so clearly 
a characteristic of a well-developed fantasy- 
life. One approach involved self-ratings on a 


simple scale devised by Small (26). The other 
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called for use of the Porteus Mazes, long de- 
scribed as measures of foresight by f a 
originator (17), a claim afforded ape 
some support in a recent study by sate 
(26). The Porteus Mazes would appear 
ticularly relevant since success in ae 
cution involves the capacity both to le : 
motor reactivity, curbing impulsive amines 
as well as the more ideational component pi 
visually moving through the mazes in a 
vance of the pencil. AEN ‘ 
Turning now to tasks and situations poi 
ing delaying capacity and control of motili Y 
one possibility that suggested itself ya i 
time-estimation procedure. Since the A 
majority of Ss tend to respond too soon W ‘i 
instructed to indicate when a stated time a 
terval has elapsed, sheer acpitacy gave Sg 
adequate measure of delaying ability a 
control of impusive reaction. A better oe 
ure might have been to consider oe 
delaying, but this occurred too rarely in her 
trials of the procedure. A measure of ee 
inhibition, a slow-writing task originally 
vised by Downey, was included. A ee 
of previous studies had suggested a co ility 
ently positive relationship between the al 
to delay writing tempo and Rorschach ee 
response (14, 23, 24). To obtain some eva ya 
tion of longitudinal gross motor tendenc i 
ratings on certain variables were agence 
from ward personnel who knew the Ss for a 
least three months. Four variables based on 
the ward behavior items drawn from pr 
Multidimensional Rating Scales (12) T 
employed. One involved aggressive henan 
frequently acting out a hostile impulse hae 
through physical assaults or verbal ean’ 
tions. Another, cooperativeness with ward ‘lle d 
tine, presumably an example of contro a 
motility, would be expected to show a pO 
tive loading on a fantasy-motility peke 
measure of external interests, as manifes a 
by behavior demonstrating some measure gi 
orientation toward the hospital activities Piy 
gram and other people, was included. Fina 7 
a series of items dealing with diffuse enert 
expenditure, gross motor activity not ne h 
dently hostile in intent, was employed, whi P 
might be expected to yield a negative or Ze 
loading on a fantasy-motility factor. ies 
In summary, then, the specific form of 
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investigation involved the prediction that a 
battery of procedures which on the surface 
Measured a wide variety of performances 
ranging from fantasy capacity as seen in 
storytelling, perception of humans in activity 
on inkblots, planning in a maze test, slow- 
writing, and controlled motility, would all be 
revealed as aspects of an underlying, more 
Se dimension in which the capacity for 
ed living and control of impulsive mo- 
a were linked. Since clinical experience 
yey previous research had suggested the 
ne of Rorschach’s Human Movement re- 
ae as a measure of both the fantasy and 
Tetori aspects of the assumed underlying 
Tesno , it was anticipated that Rorschach’s M 
ihe nse and the threshold for Human Move- 

nt on Barron’s inkblots would show espe- 


cially high loadi - oa E 
factor, gh loadings on this fantasy-motility 


Method 


erpblects. There were 100 Ss, all male vet- 
aoe bearing the diagnosis of schizo- 
asis of They were chosen chiefly on the 
schach their having recently received a Ror- 
i examination and an intelligence test. 
mean Pb age was approximately 31, 
I ate of first hospitalization 1949, mean 
age a and their years of education aver- 
group 5. Social class background for this 
Up predominantly lower-middle and 
aimee and their ethnic backgrounds ap- 
ough : the general hospital picture. Al- 
e patients in this study were un- 
e sional ly psychotic with hallucinations Or 
è va trends, only those Ss who proved 
tions sufficient contact to follow instruc- 
the sam a of the tests were employed in 
tients ie e. It should be noted that the pa- 
Sample of his study represented a different 
Vestigatio s from those used in two prior in- 
e in this series (23, 24). 
i ure. A battery of special procedures 
a ganized with an instruction booklet, 
i Scoring sheet.? With the exception of 
reques? E of the correlation matrix are available on 
Correlation y the authors. Tables giving the inter- 
tructions aS the transformation matrix, in- 
Dle data pes the various test techniques, and sam- 
can Do te eet have been deposited with the Ameri- 
4968 feo entation Institute. Order Document No. 


Yi sge 
om ADI Auxiliary Publications Project, Pho- 


and 
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the Rorschach and Wechsler-Bellevue, which 
had usually been given some weeks or 0c- 
casionally months earlier, all the data were 
obtained at one 90-minute sitting. The be- 
havior ratings were obtained shortly after 
testing by interviews with ward personnel. 
Much of the testing was carried out by two 
of the authors (J. L. S. and H. W.) with oc- 
casional administrations of the battery by 
clinical psychologist trainees who had re- 
ceived instruction in the testing procedures. 


Wechsler-Bellevue Intelligence Scale (Variable 1). 
For various practical reasons it was not possible to 
obtain full-scale IQs on all Ss, but a prorated IQ 
estimate was obtained. These estimates were based 
on verbal tests usually, and only occasionally were 
performance test IQs available. 

Rorschach. The Rorschachs were standardly ad- 
ministered examinations scored in accordance with 
Klopfer and Kelley (10). All protocols were re- 
checked by conference to eliminate the few ques- 
tionable scorings of the original examiners. The 
remaining test battery was administered by the in- 
vestigators without prior knowledge of Rorschach 
data for the Ss in order to eliminate unconscious 
influence by the examiner. All determinants were 
scored but only those with sufficient frequency of 
occurrence and range in the sample were employed 
in the analysis. The Rorschach scores with Variable 
Numbers were: Total Responses (R, var. 2), Hu- 
man Movement (M, var. 3), Animal Movement 
(FM, var. 4), Form-level (Beck’s F + 7%, var. 5), 
Black or Gray shading (Klopfer’s C', Beck's F, var. 
6), Form-Color (FC, var. 7), and Color-Form (CF, 
var. 8). 

is Movement Threshold Inkblots (Variable 
9). This test consists of thirty black blots presented 
one at a time for thirty seconds with usual Ror- 
schach instructions. Only one response per card is 
obtained and the score js based on the card in which 
the first clear M response js elicited. For purposes of 
simplifying the factor analysis, the scores on this 
variable were arbitrarily reflected prior to insertion 
in the matrix; a positive correlation in the matrix 
thus means that a low Movement Treshold is asso- 
ciated with a high score on the other variable. 

Thematic Apperception Test Transcendence Index 
(Variable 10). Four cards of the TAT were adminis- 
tered in accordance with instructions developed in 
an earlier study (24). The cards were 1, 6BM, 7BM, 
and 12BM. The ‘Transcendence Index, adapted from 
work by Weisskopf (29) called for scoring of items 
that involved addition of material not directly on 
—— ee 
toduplication Service, Library of Congress, Wash- 
ington 25, D. C. remitting in advance $1.25 for 
microfilm or $1.25 for photocopies. Make checks 
payable to Chief, Photoduplication Service, Library 
of Congress. 
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the card, e.g., new characters, names, past or fu- 
‘vents, etc. . . 

pos Selj-Rating (Variable 11). This simple 
six-point rating scale was used by Small (26) ina 
study of planning tests. It calls for S to rate himself 
along a scale of planfulness in which each point is 
defined. The points range from: “I never plan things 
in advance,” through “I always plan things out care- 
fully in advance.” i 

Porteus Mazes (Variable 12). This test was given 
in accordance with instructions in Porteus Manual 
(17). Only the quantitative score (TQ) was em- 
ployed here although further analysis by qualita- 
tive means is being planned. 

Wechsler’s Number-Square Test (Level of Aspira- 
tion). This Procedure, modified from a technique 
devised by David Wechsler, called for S to draw 
squares around numbers printed serially in rows of 
ten across a page. Instructions called for speed and 
30 seconds were allotted for a trial of 40 numbers. 
Prior to the first trial Ss were asked to estimate 
their expected performance given only the infor- 
mation that “people do between 18 and 30 in half-a- 


initial performance (Pa, Var. 14) was also em- 
ployed as a measure of sheer Speed of reaction, 
Time Estimatioy ' 


t (Variable 16). This task called 
by saying “Stop” when 
were used, 15, 
actual time w 
score. The me 
absolute deviation, 


total deviation 
Accuracy, based on 


(Variable 17). 
hnique devised 


Pace, repeating 
Psychological satiation 
‘med that they 
did so £ asked, 
to do some more?” and then, 


If Ss con- 


“Wouldn’t you like 
“Are you sure youd 


Temperament Scale, 
studies in this series 
write the phrase, 
merce,” as slowly 


of Disturbance (Vari- 
originally in a study 
3), involved straight- 


able 19). This task, employed 
on frustration by Wilensky (3 
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forward digit retention except that S was taken be- 
yond his limit of success, and his errors on the digit 
series beyond his memory span pointed out. Follow- 
ing a standard number of failures, the digit spans 
were presented in decreasing length until a long pe- 
riod of sustained success occurred. Evidence of dis- 


turbance was based on the difference between initial * | 


level and postfrustration level of digit retention. The 
variable employed here was the admission or denial 
of disturbance following failure. This was a di- 
chotomous classification; those patients whose re- 
Sponses were unintelligible or who actually refused 
to respond were not considered, and consequently 
the N for this variable was lower than for the others. 

Behavior Ratings. To obtain some evaluation of 
long-term motility patterns, items from the Multi- 
dimensional Rating Scales were grouped under four 
headings: those Pertaining to Aggression (Var. 20); 
verbal or physical assaultive and destructive behav- 
ior on the ward, Cooperativeness (Var. 21) with 
ward routine, Interest. Level (Var. 22), as seen in 
voluntary Participation in ward acti es, and Dif- 
fuse Energy Level (Var. 23), excessive motor ac- 
tivity not Specifically hostile in intent. Ward po: 
sonnel, aides, nurses, physicians, and ward clinica 
Psychologists, all of whom had daily contact with 
the patients in question as well as with the hospital’s 
daily listing of unusual behavior on each ward, w 
interviewed and each patient rated on a three-poin 
scale for each item in the four categories. The rater 


was not cognizant of test results at the time of bis 
interviews and ratings. 


Results and Statistical Analysis 


Following inspection of the various dis- 
tributions, the scores on each variable were 
dichotomized at the median. In almost all 
cases good splits were obtained, the excep- 
tions being the Authority-Reaction, where 
only 30% of Ss met the criterion of compli- 
ance and the Energy-Level variable, where 
the cut was hampered by an extremely Te- 
stricted range of scores. Following dichoto- 
mization, phi coefficients were obtained and 
transformed to estimates of Pearson’s 7 12 
accordance with the procedure suggested by 
Edwards (5). A comparative sampling of tet- 
rachoric Coefficients revealed no sizable dif- 
ferences in the Coefficients obtained by the 
two Procedures—most deviations being of the 
order of 0.01 to 0.93. Recognizing the limita- 
tions of rs obtained in this fashion, the au- 
thors are following Wittenborn’s reasoning 
(34) in attempting a factor-analytic study 
of Rorschach data. 

_A cluster analysis had led to the elimina- 
tion of a number of variables which showe' 


FA 


~~} 


ę 


_ 
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Table 1 


Centroid Loadings, Communalities, 


and Common Factor Loadings 


Variables I ul III IV ie A B @ D 
~ 1.10 (W- 7 7 7 
ao g Ww 3 27 26 —06 —17 17 01 25 19 —12 
2.R 72 27 21 18 66 07 35 3 
3 ar s2  —67 25 02 118 s1 _ 3 
: M 52 24 32 32 53 —07 27 52 52 
5 F+% 322 -1 1-17 16 22 21 —08 14 
E 25 55 —19 10 4 —19 14 57 -f 
nC 46 29  —16 33 43 07  —03 56 15 
ie CP 22 18 =i 28 18 02 -11 37 06 
as ental Battery 
. Mt 60 —47 14 33 71 56 —14 
0, a 58 27 30 06 50 —03 44 T 33 
ie 38 28 0s —47 44 02 55 07 =f 
oe 45 -12 —-28 —24 36 48 03  =07 13 
TES 38 16 38 —52 58 —01 71  —06 09 
i 31 42 21 41 48 —18 64 18 —07 
ie ee mo —30 13 (tt 14 23 o 27 15 
2 TIM 35 12 —18 12 18 17 —03 28 02 
Her 24  —16 39 30 33 04 07 11 57 
iS MIT 7⁄4 -25 -23 —10 67 69 00 00 12 
a AD 45 —26 36 20 H 24 12 05 60 
T Aeg 19 36 —16 17 22 —11 02 44 —06 
i Coop 19 —54 —26 —34 52 64 —16 —53 —15 
32. Ex I 28 27 —50 —49 64 23 16 04  —59 
Eni 15 33 -29 07 22 —04 —03 35 —21 


Neplig; 
n ies Correlations in the matrix, e.., 
y ich = of First Hospitalization, Education 
Sulting nee chiefly with IQ). The re- 
Fected to atrix of 23 variables was then sub- 
“entroiq A dantor analysis, using Thurstone s 
®stimated ethod (27). Communalities were 
relative, 7 Means of minor centroids. The 
thirg ioe residuals remaining in the 
ability im ual matrix and the unknown reli- 
tanted eyt the method of estimating 7 war- 
axes Wite raction of only four factors. The 
followin e rotated to oblique simple structure 
Wo-din 8 Thurstone’s method of rotation by 
‘ors, mensional sections. The centroid fac- 
lique f. e calculated communalities and ob- 
Since actor loadings are presented in Table 1. 
Cottelatio, oblique factors show slight inter- 
Was ee a second-order factor analysis 
tions of ied out. The matrix of intercorrela- 
factor the factors, the second-order centroid 
Mgs fee aning, and the rotated factor load- 
onsi sted in Table 2. 

Bests “fina of Factors A and D sug- 
Sig i Partial support for the hypothe- 

he study since Rorschach M and 


Movement-Threshold show sizable loadings 
on the two factors in which measures of con- 
trolled motility and fantasy are also appreci- 
ably loaded. Factor A derives by far its high- 
est loadings from M, Movement-Threshold, 
Porteus Mazes, Motor Inhibition, and Coop- 
eration in Ward Behavior. It thus appears to 
reflect controlled motility primarily and it 
seems possible that it represents the kind of 
motor restraint that would lead to compli- 
ance and inhibition of impulses. Factor D, 
on the other hand, with its sizable loadings 
on M, Movement Threshold, Admission of 


Table 2 


Intercorrelations Among Factors, Second-Order 
Centroid Loadings, and Oblique 
Rotated Loadings 


Factor A B C D I I AA BB 
A 40 44 —15 68 —16 49 15 45 
B 12-17 51-3941 14 58 
c —22 58 29 42 50 00 
D =36 -19 17 —32 —01 
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Distress after Failure, Animal cin ig 
External Interests (negative aay o 
tinuation of Task in Response to Authority, 
Rorschach Responses, and Transcendence on 
TAT stories, appears to represent an idea- 
tional or introspective dimension of person- 
ality, particularly since all of the tasks in- 
volve little or no gross motor activity. Factor 
B might well be termed an ambition or need- 
achievement factor since it combines high 
loadings on productivity measures (Perform- 
ance Speed, Rorschach Responses, and TAT 
Transcendence) with self-estimates of achieve- 
ment potential (Initial Expectation on Num- 
ber Square Test) and planfulness (Planning 
Self-Rating). Factor C with its high loading 
on Rorschach Color and Shading, Animal 
Movement, Rorschach Responses, Coopera- 
tion (Negative), Aggressive Ward Behavior, 
TAT Transcendence, and Energy Level in 
Ward Behavior, seems to represent a com- 
bination of productivity or drive with emo- 
tionality and uninhibited activity. The high 
loading of Rorschach C’ and FM would ap- 
pear to support certain views of Piotrowski 
(16), who has Suggested that numerous C’ 
and FM responses in Rorschach records are 
indicative of acting-out of impulses and ani- 
mation, respectively. Factor C may well rep- 
resent some aspect of a Pressure for outward 
direction of living, perhaps a flight into ac- 
tivity and environmental manipulation which 
is manifested both motorically (high Aggres- 
sion and Energy Level, low Cooperation) and 
ideationally (high TAT Transcendence and 
Rorschach Responses). It closely resembles 
a factor termed “Emotional Surgency” by 
Foster (6) * in a somewhat similar study of 
Rorschach data. 

In the second-order analysis, 
has a high positive loading for 
Surgency and a moderate negative loading 
on Introspectiveness. This result suggests at 
least some validity to Rorschac’ 


h’s original 
concept of the experience type. Factor BB 


is clearly defined by high loadings in Con- 


3 A recent paper by Foster (6) which came to the 
attention of the authors subsequent to the comple- 
tion of this study also describes a factor termed 
“emotional surgency” which has high loadings for 
Rorschach shading and color responses. 


Factor AA 
Emotional 
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trolled Motility and Ambitiousness or Need- 
Achievement. 


Discussion 


The results of the present a a 
while grossly supporting the formulation a 3 
vanced at the outset, make it clear that, aA 
least for this sample, the initial hypothesis 2 
a fantasy-motility dimension was overly mre 
plified. The fact that Rorschach’s Hum E 
Movement response showed significant Ey i 
relations with almost all of the variables a 
sumably measuring fantasy, planning het p 
laying ability, and motor inhibition is stri n 
confirmation of the original formulation z 
Rorschach (20) concerning Human we 
ment and of subsequent interpretations of 1 ‘ 
theoretical meaning and behavioral ue’ 
tions (14, 18, 22, 30). Although Rorscha = 
M and Barron’s Movement-Threshold Sr 
high loadings on both Factors A and D, ie 
emergence of two separate and relatively ing 
correlated factors, one primarily involvi 
motor control and the other ideational re A 
tivity, suggests a more complex irre 
than was hypothesized. It seems ae b 
at least two types of persons are like os 
Present Human Movement responses to vee 
blots. One type consists of persons with eed 
siderable ability to restrain impulsive for 
Sponse and to plan ahead and cooperate ita 
their own good in the numerous ee g 
Situations involving waiting or comp rie 
with routine. The other group, while Ser iag 
to the wishes of authority and perhaps W1 ae 
to comply, is too withdrawn into introsp to 
tion and self-evaluation or autistic reverie 
make effective use of their potentiate 5 
effective motor control and planfulness. ‘ene 
Speculative distinction suggests more €x o 
sive qualitative exploration of the Dau 

ovement responses, perhaps to deei i 
Whether differences in content or elabora ia 
of the percept may account for the aor 
tion of M responses with the two a. i 
Patterns of response. Inasmuch as the a 
Human Movement measures have high ee 
ings on both the Motor and Ideational = 
tors in this study, the theory linking mov 
ment Perception with controlled motility an 
fantasy receives some support. It may yea 
be that the split factors which have emerg 


a$ 


Ki 
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may be a consequence of the pathology of the 
Patients and that study of a normal sample 
might clarify this issue considerably. Should 
fantasy-motility linkages emerge in other 
studies of this sort, the possibility of an op- 
erational formulation of the concept of ego 
functions may open important research ave- 
nues. At a theoretical level, it may become 
feasible to explore the nature of individual 
differences in thinking and motility as a func- 
tion of family constellation or cultural back- 
Stound (25). From a practical standpoint the 
development of a battery of tests of the sort 
€scribed here may afford an opportunity to 
Mprove the nature of individual psychologi- 
cal testing by the use of brief tests tapping 
Separate aspects of a common function. Such 
fa development has indeed been advocated by 
investigators like Zubin (35), who have been 
Critical of the interpretative complexities in- 
went in the use of global projective devices 

© the Rorschach. 
in thi. two remaining factors which emerged 
inte 1S study, while not anticipated, provide 
well ene Possibilities for fruitful study as 
On ;, Emotional Surgency, with its loadings 
n ideational productivity, aggressive or dif- 
an que behavior, and Rorschach Color 
ties Shading, calls attention to the possibili- 
aces exploring still another dimension of 
ele Ption and action. It is possible that some 

ment of lack of perceptual control (34) 


i 


, . “V5 

ie along with a concomitant inability to 
a i i othesis 

Would otor behavior. This hyp 


ing of e sufficiently explain the high load- 
Orschach Animal Movement responses 

this of Form-dominated Color responses in 
Sample, however, and it remains to be 
Whether further studies duplicate these 
S. Factor B, tentatively termed Ambi- 
or Need-Achievement, suggests the 
f individuals who feel compelled to 
at hat they are planful and can do well 
Press E they have not attempted before and 
be imp d for such accomplishment. It may 
loag Portant to note that IQ, which does not 
its rT lage on any of the factors, has 
for Sst value in Factor B. Thus, at least 
Pears T sample of schizophrenics, it ap- 
achiey, se Personality dimension involving 
ement drive and a need to appear plan- 


Seen 
Teg 

Ousness 
Picture o 
aSsert g 
l 


381 


ful may be delineated and proves to be rela- 
tively independent of fantasy tendencies. 

A final question that may be raised in con- 
nection with these findings of the second- 
order analysis is whether the four factors 
bear any diagnostic psychopathological sig- 
nificance. One might, for example, speculate 
on a hierarchical ordering of Factors BB and 
AA relative to an ideal criterion of mental 
health (or well-integrated ego functioning). 
Thus, Factor BB with its pattern of planful- 
ness, motor control, and ward cooperative- 
ness as well as ambitiousness, might repre- 
sent a more effective level of functioning than 
Factor AA, where there is a suggestion of ex- 
cessive withdrawal (Low External Interests) 
and Emotional Surgency with its indication 
of aggressive behavior and uncooperativeness 
as well as diffuse motor activity. Since dura- 
tion of illness and florid symptomatology did 
not appear to differentiate between various 
subgroups in this sample, such an ordering of 
psychopathological tendencies seems less ten- 
able although it remains reasonable to ex- 
pect that an optimal association of fantasy 
and delaying capacity would lead to more 
effective living. For the present these results, 
like those of Barron (1), suggest that differ- 
ing styles or patterns of fantasy and motility 
behavior are indeed discriminable through the 
use of relatively simple psychological testing 
procedures. It seems clear that many of the 
problems raised by consideration of these re- 
sults are relevant for general personality the- 
ory and indicate the value of research that is 
not geared toward differentiating one dubious 
psychiatric nosological group from another, 
but rather toward clarifying the interrelations 
of certain key human functions as the basis 
for what may ultimately become a more 
meaningful and objective system of person- 
ality classification. That the delineation of 
functional personality dimensions is not purely 
speculative is suggested by the fact that Fac- 
tors A, D, and C here bear some resemblance 
to factors reported by Foster (6) as “Delay” 
and “Emotional Surgency,” by Cattell (4) as 
“Nervous, alert reactivity” and “Cultured in- 
trospective self-control,” as well as by Thur- 
stone (28) as “Reflectiveness” and “Impul- 
sivity.” The work of Block and Martin (3) 
in delineating “Under-” and “Over-control- 
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ling” children seems also to bear directly on 
g 
these factors. 


Summary and Conclusions 


A number of concepts drawn from the psy- 
choanalytic theory of thought development, 
Werner’s sensory-tonic theory of perception, 
and Rorschach’s work on the Human Move- 
ment response (M), have led to the postula- 
tion of a dimension of personality which in- 
volves a linkage of fantasy tendencies with 
control of motility and impulsive behavior. 
In order to test this hypothesis a battery 
of tests which presumably measured fantasy 
tendencies, level of aspiration, planning abil- 
ity, delaying capacity, motor inhibition and 
motility, and responsiveness in ward behav- 
ior was developed. The battery was adminis- 
tered to 100 male schizophrenic patients, A 
factor analysis yielded four centroid factors 
which were subjected to an oblique rotation 
to simple structure. The four rotated factors 
were tentatively designated as: 

1. Motor Inhibition and Plan 
loadings on Rorschach M, Move 
old, Porteus Maze Test Quotie 
hibition Time, and Cooperativeness in ward 
behavior) ; 2, Ambitiousness or N eed-Achieve- 
ment (high loadings on Initial Expectation 
in a level-of-aspiration situation, Initial Per- 
formance in the same task, Planning Self- 
Rating, Transcendence in TAT stories, and 
Rorschach Response Total); 3. Emotional 
Surgency (high loadings on Rorschach Re- 
sponses, Animal M 


ovement, Shading and 
Color, TAT Transcendence, Aggressiveness 


, ~ DCOOperativeness, and Diffuse 
ivity); 4. Introspectiveness or In- 
troversiveness (high loadings on Rorschach 
M, Animal Movement Responses, Movement 
Threshold, TAT Transcendence, Admission of 
Distress following Failure, Continuation of 
Task in Compliance with Authority, and 
Lack of External Interests in Ward Be- 
havior). 

The high loadings of Movement-threshold 
and Rorschach’s M on both the Motor In- 
hibition and the Introspective Factors sug- 
gest partial support for the original hypothe- 
sis but the emergence of two separate factors 
for motility and fantasy activity indicates 
that the original formulation was overly sim- 


fulness (high 
ment-Thresh- 
nt, Motor In- 
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plified. The Emotional oe cl Pg r 
fords some support to Piotrowski’s ana hes 
of the behavioral implications of Rorschac! 

Shading and Animal Movement responses: 
Two second-order factors, one linking sore 
tional Surgency and lack of Introspection on 
the other Motor Inhibition and Ambitiou 

ness also emerged. 
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The Development of a Short Form of the 
Manifest Anxiety Scale? 


A. W. Bendig 


University of Pittsburgh 


Two studies (1, 2) have indicated that a 
majority of the 50 items on Taylor’s Manifest 
Anxiety Scale (MAS) are not valid in pre- 
dicting clinical criteria of manifest anxiety. 
The consistency in item validity results of 
independent studies suggests that a short- 
ened form of the MAS, retaining only the 
valid items, might be more useful and clini- 
cally valid than the standard MAS. However, 
such a shortened MAS might Jack the desir- 
able normative characteristics, such as high 
reliability, of the longer MAS. 

The 20 most consistently valid MAS items 
in the reports noted above (Item 1-16 and 
29-32 in 2, p. 360) were selected as a short- 
ened form of the MAS. The 50-item MAS 
was administered to 744 college Ss and their 
Papers scored for the 20-item scale. The 20- 
item scale, omitting the 30 “nonvalid” items, 
was given to an additional 324 Ss. No sig- 


means or vari- 


1 An extended report of this study may be ob- 
tained without charge from A. W. Bendig, Dept. of 
Psychology, University of Pittsburgh, Pittsburgh 13, 
Pa., or for a fee from the erican Documentation 
Institute. Order Document No. 4990 from ADI Aux- 
iliary Publications Project, Photoduplication Sery- 
ice, Library of Congress, Washington 25, D. C, 
remitting $1.25 for microfilm or $1.25 for Photo- 
copies. Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress, 


evident. A survey of studies using the R 
item MAS shows its median internal wom 
ency reliability to be .82, while me ou 
reliability of the 20-item scale was .7 ‘So: who 
Scores were obtained for 100 random ae 
had taken the 50-item form: (a) score ‘tems; 
50 items, (b) score on the 20 “valid valid” 
and (c) their scores on the 30 oe ace 
items. The reliabilities of the re? in- 
Were: (a) .78, (b) .76, and (c) .48. = te 
tercorrelations among the scores TO) and 
and (b), .93; (a) and (c) .91; and 

-70. x itts- 
E concluded that the aye 
burgh revision of the MAS (a) has e EE 
from the standard MAS items of loi : scores 
Consistency and validity; (b) provides 
that are about as reliable as the ee and 
and are highly related to scores ont usid 
ard form; and (c) is more Datan d than 
testing time and probably more va 
the longer MAS. 


Brief Report. 
Received June 25, 1956. 
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Perception of Apparent Motion in Organics 
and Schizophrenics 


Rayford T. Saucer 
VA Hospital, Perry Point, Maryland 


and Herdis L. Deabler 
Gulfport Division, VA Center, Biloxi, Mississippi 


M anai; Singer, and Wilensky, in their 

cerning ER (3) recent findings con- 

brain lesi e psychological consequences of 

ite i esions and ablations, make the follow- 
atement: 


P 
suggest. fo research with brain-injured patients 
gist in the at the repertory of the clinical psycholo- 
Soon be au examination of neurological patients may 
tory ee by the use of specialized labora- 
Critical se such as tachistoscopic presentation, 
Vement ih r fusion frequency testing, apparent 
Strument” t resholds, and other so-called “brass in- 
cchniques techniques. The value of these perceptual 

; seen localization of lesions remains equivo- 
tual impairs clear, nevertheless, that subtle percep- 
ral injur: ments or reorganizations following cere- 
laboratory are most clearly brought out by intensive 
Used gloh examination rather than by the widely 

al clinical methods . . . (3, p. 11). 


AN 
me 2 — paper is a report of an experi- 
together le perception of apparent motion, 
Cations With its theoretical bases and impli- 
sult of Pac attempts to show that as a re- 
ture rese creased knowledge in this area, fu- 
t of arch in it may lead to the develop- 
“tument a reasonably critical diagnostic in- 
limas and Thuma (10) found that brain- 
of tachi children failed to report perception 
e dee apparent motion. Relating 
tion, th cit to Goldstein’s theory of percep- 
ize a €Y attributed it to inability to organ- 
hela te ye eround relationships, which they 
Physio] be a fundamental principle of neuro- 
tributa Sica] organization. Shapiro (9) at- 
quatin the deficit to satiation in the cortex, 
8 the effect of continuous visual stimu- 


lation to the effect of organic damage, i 
cordance with Köhler and Wallach’e (4) the 
ory of satiation. Wallach’s (4) the- 

Price and Deabler (6), in a 
signed to extend Freeman and aa d a 
work on perception of the apparently moving 
afterimage induced by a rotating Archimedes 
spiral, report that 98 per cent of the known 
organic patients tested had difficulty in per- 
ceiving or failed to report this distinctive 
illusion. In discussing their results, they sug- 
gest that either a field theory or a theory of 
perception proposed by one of the writers 
may be used to explain their findings. 

Earlier work in the field of apparent mo- 
tion by one of the writers (7, 8) has led to 
the development of new techniques for the 
study of apparent motion. In the present 
study, apparent motion is produced by use 
of two alternately flashing light bulbs which 
are 14-inch neon-filled, fluorescent coated 
Westinghouse Nite-Lites mounted on a verti- 
cal black board. These are illuminated alter- 
nately, with zero pause time between flashes, 
by a multivibrator square wave generator, the 
circuit of which is conventional. 

It is found that varying the rate of alter- 
nation of light flashes from 2 to 10 per second 
causes the light stimuli to appear in three 
phases which are directly related to the fre- 
quency of flashes. As the frequency increases, 
the stimuli may be perceived and described 
as (a) successive alternating appearance of 
each light; (b) apparent movement wherein 
the two lights seem to fuse into one light 
which appears to swing smoothly from side 
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x. The threshold for loss of 
to side; and (c) simultaneous E e, a n h eg itself as a 
bap ee im a measuring index for determining cortical e 
ade pe perceived in Phase b r soi y g pee that organics with 

i i ; Is to be Š 
te (le Oe their decreased cortical eae be pes 
to i i 7- lower thresholds for loss of Be en. 
has since been investigated by numerous psy foe Gal, Gales 
i ing 7 desig- pearance of Omega tha mi 

E ie peda y jehai tt pienie by operational definition and 
S F aa to in this Study. their performance on most psychologica pe 
j the lit stimuli are made diffuse, with are known to have low cortical ma i bee 
no sharply defined boundaries, such as is ac- They are included in this ouy = a iet 
complished by use of a ground-glass screen whether or not this is a vchiatrie 
placed about one inch in front of the bulbs, Omega threshold or whether t s p aut 
then the last state, Phase ¢, may result in group remains essentially norma sh 
a phenomenon earlier reported (7) called to ability to Perceive apparent Qs this study 
Omega movement. Omega movement appears It is the specific hypothesis o Ete at 
as movement of a dark, quasi-formless, amor- that as the rate of alternation o a asned 
phous object. It has movement but differs lights is changed, organics will have i 2 
from Beta in that it does not have the at- experimental threshold for Omega or 


aes able 
tributes of the primary stimulus. It has a Beta than normals, and it is highly prob 
minimal amount of “thing” 


5 : than 
& quality and js that schizophrenics will also be lower 

frequently reported as “a dark shadow moy- normals, 

ing back and forth.” 


j and Method 
The body of evidence indicates a deficit in Subjects and 


z group 
perceive apparent Four groups of 10 male subjects perg the 
deficit reported by were used in this experiment, 0 opula- 
Price and Deabler may be a phase of a Sen- groups being drawn from the patient p group 
eral disturbance of the perception of appar- tion of a psychiatric hospital and one nd at- 

i from the population of nursing aides a 


. or- 
5 tendants. The groups were desint A 
„theory of motion perception has been ganic, schizophrenic lobotomized, an 
previously presented Ci; trol. 
states that motion Perception js based on a : ital staff was uet 
matrix synthesis of perceptual organizations Diagnosis of patients by m l gigat 
i timulus detail and for ahs Ge E gouping, the opinion ot fie 
e stimulus configura- chiatrists, psychologists, and occasionally, PSY curren 
tion. Beta motion, in which the apparently consultants. Patients were selected from the 
moving object has the attributes 


Š resente! 
of the pri- case book of the Psychology Service and rep 5 
mary stimulus, may be regarded 
diagnosti a of 
from that K seh el y 
which gives optimal Beta motion, ieobolic. an 
issociates, Organic involvement was favored, Alc 
a : qua. 
observer reports seeing either the two lights S4Mic patients tested carried a secondary or 
D 
3 uar 
schizophrenic reaction, undifferentiated type- dis- 
for loss of Beta is the same as for appearance r 
in the & 
; : ity NOt Used. All schizophrenic patients used in 
Beta perception at higher levels of complexity 


f jon. 
as a syn- @ random sampling of a hospital popular articulat 
thesis of stimulus detail and Motion. When believed that they were typical for 

Ro Goce a 
the rate of alternation 1s increased though many organie subjects had a om 3 
k the com- one or more brain injuries, no particular Ci 
thesis breaks apart or d yl or- 
plex or syn ; : ically 2 ify- 
Perception of Beta movement is lost and the Senile syndromes were excluded. Practica lify 
: 1 : 5 fan í 
i ìng diagnosis of “with psychotic reaction ory ° 
as stationary or the Omega movement phe- Schizophrenics were taken from the categ his- 
nomenon. Practically speaking, the threshold other 
tory of concussion damage, blackouts, Precis were 
f Omega. It is felt that the ability to Sustain orders of consciousness was elicited, subj 5 
Or ADRES jnatio® 
a! 
y i periment had experienced delusions or pann wil 
is dependent upon the functional efficiency of at Some period during their psychosis. Patie 
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a history of ECT or ICT during the previous three 
months were not used. 

ao Freeman-Watts lobotomy cases were also in- 
cluded in the study for comparative purposes. All 
were diagnosed chronic schizophrenics prior to the 
lobotomy, 

_The controls were selected at random from male 
aides employed in the psychiatric hospital. They 
bg used because it was felt that they represented 
si group of individuals of average intelligence and 
imilar cultural background to the majority of the 
Patients used. 


Subjects were brought into a darkened room 
and seated two meters from the light source. 
In a pilot study, it was found that a flash rate 
of 2.5 flashes per second gave optimal Beta 
ila for most subjects. This rate was 

en used as a baseline for the experiment. 
Fe rate control was set at 2.5 f.p-S and 
| subject was asked to report what he saw. 
Of the 40 subjects tested, two organic sub- 
Jects failed to report Beta movement; of 

ese, one reported Omega and another re- 
Ported seeing no motion of any description. 

€ flash rate was then raised in steps of 0.5 
PS. every 30 seconds until the subject re- 
Ported Omega movement. In a few cases the 
vets organization was broken up by Sim” ‘ 
: neous appearance of two fused lights, whic 
presented a high threshold of dissociation. 
his point was equated to the perception of 
mega motion (8). 


Results 


ware tate at which Omega motion became 
appear or the rate at which the two lights 
eras simultaneously was taken as the 
The an ld of dissociation of Beta movement. 
eir r rates for the diagnostic groups and 
Te standard deviations are given 
vt can be seen from Table 1 that the means 
a € ranked from organic through normal. 

Ysis of the significance of the difference 


in 


Thresh Table 1 
old Means and Standard Deviations of Groups 
Mea, Schizo-  Loboto- 
M Sure Organics phrenics mies Control 
e z 
Sign 3583.96 445 452 
mas 22 13 22 .14 
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Table 2 


Analysis of Variance 


Sum of 
Source Squares df F 
Total 19.19 39 
Between 5.94 3 5.50 
Within 13.26 36 


of the means is contingent upon the results 
of the analysis of variance and will be pre- 
sented in that order. 

Since a test for homogeneity of variance 
indicated that the variance of the groups rep- 
resents no more than chance distribution, 
analysis of variance for between and within 
categories was applied to the data. The re- 
sults are given in Table 2. 

For 3 and 36 degrees of freedom, an F 
ratio of 5.50 is significant beyond the .01 
level but not to the .001 level of significance. 
The null hypothesis, that these groups repre- 
sent random samples drawn from a common 
population, can be rejected at a satisfactory 
level of confidence. It may then be concluded 
that the threshold for the dissociation of Beta 
apparent motion is related to the presence of 


pathology. 


Following 
standard error of th 


McNemar (5, pp- 74-75), the 
e difference can be com- 
puted by using the within-variance as the 
best estimate of the population variance. If 
this is done, the standard error of the differ- 
ence for the groups can be based on N — k 
degrees of freedom, where V is 40 and & is 4. 
Thus, 36 degrees of freedom are available for 
the various tests. The various tests are sum- 


marized in Table 3. 


Table 3 
Significance of Mean Differences 
Groups Compared t Significance 
Organic-Schizophrenic 1.5 NS 
Organic-Lobotomy 3.3 O1 
Organic-Normal 3.5 O1 
Schizophrenic-Lobotomy 1.7 05 
Schizophrenic-Normal Zi .025 
Lobotomy-Normal NS 
OS-LN 3.78 OL 
OS-N 3.40 01 
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For four of the pairs, a ¢ which is not quite 
significant at the .001 level of significance but 
well beyond the .01 level can be established. 
Two are not significant and two are signifi- 
cant at the .05 level of confidence. Current 
statistical practice sets no level for rejecting 
the null hypothesis, although the writers feel 
that the confidence level should at least ex- 
ceed .01 before the null hypothesis is rejected. 
If we wish to consider these ratios asa CR 
(since 36 degrees of freedom are involved), 
then those ratios above 3.3 rise considerably 
above the .001 level of significance. The 
writers prefer the more conservative evalua- 
tion. 

Discussion 


The primary hypothesis that organics differ 
from normal or control subjects in O 


mega 
threshold has been established at a highly 
significant level of significance. Thus we may 
expect that as test 


Suggests that an appa: 


technique May assist 
Conditions, 


nt poi 

tinuum of cortical efficiency, PEA, tot 
If the results are examined in the light of 
a neural network frame of reference they b 
come meaningful. A matrix theory of «Treg 
tion can be expanded to include the citie 
cerebral cortex as a single matrix, Any dam- 
age to any part of this matrix Tepresents g 
loss and hence lowers the functional efficiency 
of the matrix. One of the major functions of 
the cortical matrix is to mediate contact be- 
tween the organism and the environment by 
ordering the information received through 
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sensory channels. The subjects selected as or- 
ganic demonstrate damage to the visual per- 
ceptive mechanisms regardless of the type of 
cortical damage. Evidently perception cannot 
be fractioned into visual or other components 
but is a global effort of the entire cortex. oa 
continuum on which the subjects are ranke 
is the continuum of over-all efficiency of the 
cerebral cortex, not the efficiency of the visua 
pathways and visual projection areas alone. e 
The organic subject exhibits deficit betats 
of damage to neural processes. The schizo- 
phrenic, on the other hand, shows deficit be 
cause of psychological factors which may on 
may not have a demonstrable isomorphi 
Physiological basis. A large part of the cortex 
of the schizophrenic is involved in deana 
with problems arising from emotions such a 
hostility toward a basically unfriendly Gai 
ronment. Neural matrices normally used E 
mediating environmental contact a ae 
rupted by being organized into matrices ‘aly 
cerned with problems which we may met 
define as emotional or as internal. Such ee 
mechanisms as are involved in these ens 
Processes must be subtracted from the n to 
total amount of cortical tissue available 5 
the organism for the mediation of con ac- 
with the environment. By a law of mass a- 
tion, the results are not to be clearly seP 
rated from the results of organic damage re- 
The interpretation of schizophrenic that 
Sponses may be inferred from the fact they 
when lobotomized patients are tested 
fall toward the “normal” rather than en 
“deficit” end of the continuum. As ba ee 
mentioned, these patients were chronic s¢ jes. 
phrenics unimproved by other ewe 
When the subcortical tracts which en are 
emotional responses to sensory materia h re 
out, they tend to return to the norm visa 
Spect to perceptual organization. As the ti 
damage is mainly in subcortical arean 
functional Gestalt of the cortex is 20 
stroyed, p þe 
From the experimental evidence, it wort 
inferred that perception is a global ed 
of the entire cortex and that by one ple 
the amount of organizational force avai en 
to the individual for use in perceptual Pion, 
esses such as perception of apparent cate 
the functional efficiency of the indiv! 


de- 
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may be measured and presence or absence of 
Pathology determined. 


Summary 


Experiments reported by previous investi- 
gators indicated a deficit in the perception of 
apparent motion by organic individuals. The 
hypothesis that the deficit is due to lowered 
organizational ability has been advanced. The 
degree of organizational ability of the indi- 
Vidual would be reflected in the threshold for 

Issociation of Beta apparent motion into 
component parts of detail and Omega move- 
Ment, 

Organics, schizophrenics, lobotomy cases, 
and controls were examined for threshold of 
a dissociation, Analysis of variance indi- 

ates that the null hypothesis—that these 

rion Stoups are random samples of a com- 

eag o ulation with respect to the variable 
ey, 1 red—can be rejected at beyond the .01 

: of significance. 
of s 18 concluded that the threshold for loss 
ies apparent motion can differentiate be- 
ferred Certain clinical groups, and it is m- 
gani that these differences are due to or- 
of th, or functional loss of organizing capacity 
es cerebral cortex as a whole rendering it 

5 able to synthesize sensory data. 


R . 
ceived November 1, 1955. 
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Emotional and Intellectual Concomitants of “ 


Advanced Chronic Alcoholism 


George A. Peters, Jr? 


Boston Regional Office, Veterans Administration 


Much has been written Concerning the ef- 
fects of excessive drinking on human mental 
Processes. The chronic alcoholic has been 
variously labeled as 
rotic, 


mental hos- 
Psychoanalysts’ case loads, and the 


thought to be m 
tive of chronic alcoholics in th 
lation was drawn from i 


ore Tepresenta- 


‘sychologist, Ale i 
eneral Hospital, 
ssed for the aid gi 


for microfilm or $2.50 
payable to Chief, Photoduplication Service, 
of Congress. 


Administration of the WERHSIET BRIK 
Intelligence Scale revealed a wide e 
mental ability, little variation between d 
verbal and performance subtest scores, m 
a slightly higher mean score than found re 
the general] Population standardization ar 
(Full Scale mean 106.2, SD 13.89; Ver n 
mean 106.1, SD 14.21; Performance a 
105.1, SD 13.72.) Academic accomplishment 
Tanged from below the level of basic rs 
tion to possession of a doctoral degree. th 
median school grade completed was the ten 
rade, g 
i Diagnosis in accordance with the gil 
biologic nomenclature of the American hese 
chiatric Association indicated that t sy- 
chronic alcoholics were not primarily Par 
chotic (8.3%), psychoneurotic (Sa 
sociopathic (5.0%). The number eae) 
as chronic or acute brain syndrome (5. vel- 
indicates that only a small minority aee 
oped clinical symptoms of central ae 
system “organicity.” Over half (52.5%) e 
classified as manifesting symptoms indica 
of a Personality Disorder. e 

his group of patients suffering from ae 
Physical complications of advanced anal 
alcoholism displayed no evidence of ae 
intellectual deterioration on the basis of seat 

Scores. The majority of cases were on- 
described as manifesting a variety of oe 
ality disorders rather than oie 
roses, sociopathic, or brain syndromes. 1 ur- 
Sample is used as a criterion, there is a 5 or 
Prising lack of major psychiatric aoa 
Testriction of intellectual capability in 
advanced Stages of chronic alcoholism. 
Brief Report. 
Received April 2, 1956, 
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Repression and Insight as Related to Reaction 
to Cartoons 


Seymour Epstein and Richard Smith 


University of Massachusetts 


$ fommonly accepted theory of humor is 
Wibreri, udian view that repression favors an 
materal a of humor in which the repressed 
Studies 1S represented (7). Although several 
ave “Me the nature of the humor response 
lorseq =. reported, most of which have en- 
ese gt coe view, a critical appraisal of 
direct] udies indicates that they fail to deal 
t Y with the Freudian hypothesis. What 
a Oss reveal is that (a) individuals show 
humor i preference for certain types of 
for font! 3, 4, 5, 8, 12, 13), (b) preference 
Other eu types of humor can be related to 
(c) Personality variables (2, 4, 5, 9), and 
can reference for certain types of humor 

n hea to adjustment (12). 
Sis it yy er to evaluate the Freudian hypothe- 

Pref ould be desirable to obtain a measure 
Secure erence for a certain type of humor, to 
anq ¿ 7 independent measure of repression, 
Cant re etermine whether there is a signifi- 
What p 4onship between the two. This is 

© present study proposes to do. 


C 


Method 


i nostility was selected as the variable to be 
d because, as a socially disap- 
Tait, it is subject to repression and 
'S a considerable amount of humor de- 

e eren, it. In order to obtain a measure of 
16 nop pee for hostile humor, 16 hostile and 
lecti nhostile cartoons were obtained by se- 
by red only those unanimously agreed upon 
Th é “pendent decisions from five judges. 
Tang artoons finally selected were assigned 
divi u numbers and presented to each S in- 
Sw, 3 ly with two sets of instructions. First 
She of © rate each cartoon by placing it into 
ree bins according to whether it was 


“funny,” “mediocre,” or “not funny.” As $ 
observed each cartoon, E (examiner) unob- 
trusively recorded on a checklist whether S’s 
expressive reaction was: (a) a negative verbal 
expression, (b) a negative facial expression, 
(c) no reaction, (d) a positive facial expres- 
sion, (e) a positive verbal expression. After $ 
had completed sorting the cartoons, E shuffled 
them and instructed S to rearrange them in a 
Q sort by placing the funniest cartoons far- 
thest to the right and the least funny farthest 
to the left. The Q sort contained seven col- 
umns with successive frequencies 2, 4, 6, 8, 
6, 4, 2. The Q sort differed from the initial 
ratings in that it required that each cartoon 
be judged relative to all other cartoons, 
Establishing a measure of repression was 
more difficult than measuring reaction to 
humor. According to Freud, “The essence of 
repression lies simply in the function of re- 
jecting and keeping something out of con- 
sciousness” (7, p. 86). Accordingly, it would 
seem reasonable to assume that repressed im- 
pulses would achieve expression in everyday 
behavior to a greater extent than they would 
be consciously acknowledged. Consequently, 
an operational measure of repressed hostility 
was established as the degree to which a per- 
son denied the hostility attributed to him by 
a consensus of persons who knew him over an 
extended period. A measure of insight was 
obtained by considering the absolute dis- 
crepancy without regard to direction (2, 11). 
Thirty-two fraternity members who had 
known each other for at least a year served 
as Ss. A week after having sorted the car- 
toons, each S was again seen individually and 
presented with 32 cards containing the names 
of all Ss, including his own. It was requested 
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that the cards be placed in a Q Nae ce 
the person who most approached t : ol s A 
ing description would be farthest to the right: 
“This person is an individual who tends 2 
be inconsiderate, antagonistic, and resentful. 
When talking about others he is apt to em- 
phasize their faults although he does not like 
this done to himself. He has little sympathy 
for others and enjoys putting them on the 
spot. He makes disparaging remarks about 
people and argues for the sake of argument. 
It is important for him to come out on top 
and he is apt to be a sore loser in compe- 
tition.” This definition was made to be rele- 
vant to the manifestations of hostility that 


Results 


An index of repression and 
tained by subtracting from ¢ 
hostility on the 


» Were divided into thre 
nine each: (a) a group that Overestimated 
its hostility and was moderately lacking in 
insight, with a mean Self-minus-others score 
of 1.03, (b) a 


group that very slightly un- 
derestimated its hostility and was relatively 
insightful, with a 0.36, and (c) 


a group that considerably underestimated its 
hostility and ing in insight, 
with a mean . For simplicity, the 

be referred to as Re- 


As there was some danger that th 
of insight and repression 
with absolute level of hostil 
were compared on mean hostility ratings by a 
simple between-within analysis of „Variance, 
An F of less than one was obtained indicatin 
that any differences in over-all hostility were 
well within chance expectancy. ; 

In scoring expressive Teactions, a weight of 


and Richard Smith 


. a 
one was given to facial ee M ote 
weight of two to verbal pe iim eeh aE 
sis of variance was then performe following: 
lowed for an evaluation of mathe 
Repression Groups (R), Subjec rable reac- 
group (S), Favorable vs. — (©), 
tion (F), Hostile vs. control To C RXF 
and the interactions R X F, R á of the 
xC, SXF, and $x C. ti ra critical 
hypothesis under investigation, satan indi- 
Source of variance is R X F X oe in fa- 
Cates whether Repression Groups di ‘ative to 
vorableness of response to hostile id not ap- 
control cartoons, This — i A Jess than 
proach significance, yielding an concerning 
one. A second source of E RXG, 
Repression Groups is the interac s differ 2 
Which indicates whether the PEOR kind, t0 
amount of reaction, irrespective Here, t00, 
hostile relative to control cartoons. a 
the F was less than one, SE tS mist z 
of relationship. The only source fhi ch ap 
telating to Repression ee indicates 
Proached significance was R, wal The F 0 
total amount of expressive sce ate signif- 
2.68 was below the 3.40 required st a tren! 
cance at the .05 level, but did ania 
which is borne out by further fin the grou 
order of the means was 9.69 for hostility, 
that moderately overestimated a deresti- 
4.94 for the group that slightly the grou 
mated its hostility, and 5.11 for hostility: 
that Considerably underestimated < are @i 
Considering that the last two mea roup tha! 
most identical, it appears that the g be morê 
overestimated its hostility tended i adition®! 
expressive than the other wa: nce are 2 
findings from the analysis of TS eaitaBib indi- 
follows: (a) There were highly re in amou t 
vidual differences (.001 level) both ; ) Favor 
and favorableness of expression, ( tly more 
able expression occurred significan z 1 
often than unfavorable expressio elicite 
level), and (c) The hostile cartoons contr! 
more favorable reactions than the 
Cartoons (.01 level), cartoo 
The data from 5’s ratings of the as £ 
were analyzed in the same ma unfavorabl® 
Pressive reactions, Favorable and un oss e 
ratings were summated independen 


ight of 261” 
“mediocre” rating receiving a weig 


| 
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Repression Groups were found to differ sig- 
nificantly (.01 level) on total amount of re- 
action in a manner confirming the nonsignifi- 
cant tendency noted for expressive behavior. 
The only other significant source of variance 
(.001 level) indicated that the hostile car- 
toons were rated more favorably than the 
control cartoons. 

The data from the Q sort were evaluated 
by assigning weights of one to seven to the 
Successive columns into which the 32 car- 
toons had been sorted. Scores consisted of 
the weight received on each of the 16 hostile 
Cartoons. Analysis of variance revealed that 
Repression Groups did not differ significantly 
either in their reaction to the pooled hostile 
Cartoons or in their evaluation of the indi- 
vidual hostile cartoons. The only statistically 
Significant finding (.001 level) was that some 
of the hostile cartoons were judged funnier 

an others. Despite the lack of a reliable re- 
{tionship between repression and reaction to 
individual cartoons, the data were inspected 
or leads for further work. It was observed 
that the cartoon which was ranked first in 
"nniness by the group that considerably un- 

€testimated its hostility was ranked sixth 

Y the group that slightly understimated its 

hostility and ninth by the group that over- 
estimated its hostility. Thus, preference for 
of ~cattoon was directly related to denial 
P hostility, The cartoon was one by Virgil 
_attch depicting a wife plunging a revolving 
gee beater into the back of her husband, and 
Pri 8, “Stick ’em up!” It was Æ’s impres- 
oe Confirmed by independent decisions 
Pate three other judges, that this cartoon 
sam x most straightforwardly hostile in the 
bo €. Unfortunately, only two similar car- 
ino © Of the “practical joke” variety depict- 
n unprovoked act of hostility by an 
could be found. In both cases a direct 
Onship was indicated between repression 

Preference for the cartoon. 

S: n order to determine whether it is neces- 
of %10 take into account level of eager 
Nee cartoons, two separate analyses Pa 
biisea S of Q-sort ratings were done, On 
the ;_ OD the four least funny, the other on 
toon. u Most funny hostile and control car- 
the S as determined by the mean rating of 
cartoon, On the least funny cartoons Re- 


a 
adult 
řelati 
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pression Groups did not differ in preference 
for hostile relative to control cartoons but 
did differ in over-all rating of the pooled car- 
toons (.05 level). The order of the means was 
29.33 for the group that considerably under- 
estimated its hostility, 25.11 for the accurate 
group that very slightly underestimated its 
hostility, and 26.00 for the group that con- 
siderably overestimated its hostility. Thus, 
the group that evaluated itself most accu- 
rately judged the poor cartoons most appro- 
priately, and the reverse holds for the group 
that evaluated itself most inaccurately. On 
the most funny cartoon, Repression Groups 
did not differ significantly in their reaction 
to the pooled cartoons, but the order of the 
means for the same three groups was, respec- 
tively, 36.44, 39.56, and 37.00, which again 
suggested that accuracy of self-evaluation was 
directly related to appropriateness of reaction 
to the cartoons. Thus, taken together the 
findings on the least and most funny cartoons 
indicated a direct relationship between in- 
sight and sense of humor. aks 

In order to determine the relationship be- 
tween the three measures of reaction to hos- 
tile cartoons, Pearson product-moment cor- 
relations were computed. To do this, the 
measure of expressive reaction was expressed 
as a ratio of favorable reactions to hostile 
cartoons over favorable reactions to all car- 
toons. The same index was used for cartoon- 
ratings. For the Q sort, the score was simply 
the total weight on the hostile cartoons. The 
following correlations were obtained: expres- 
sive reaction and cartoon-rating, .57; expres- 
sive reaction and Q sort, .52; and cartoon- 
rating and Q sort, .79. All correlations are 
significant beyond the .01 level (ż test, N= 
32). These results indicate a significant de- 
gree of reliability which is at least .52 for 
expressive reaction and .79 for cartoon-rat- 
ing and for Q sort. That the measure of ex- 
pressive reaction correlated lowest with the 
other two may indicate that it has the lowest 
reliability or that it measured something 
unique, or both. There is some evidence in 
support of the latter possibility in that ex- 
pressive reaction was the only measure on 
which significant individual differences were 
found. 
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Discussion 


Repression and humor. The results of this 
study fail to support the hypothesis that re- 
pression of hostility is related to a general 
preference for hostile cartoons. Negative re- 
sults are difficult to interpret as there is no 
way of knowing whether different operational 
measures or different populations would have 
produced different findings. In defense of the 
measure of reaction to cartoons used, ade- 
quate reliability for group differentiation was 
indicated. Moreover, validity was somewhat 
supported by the finding that reaction to car- 
toons was meaningfully related to insight. 
The measure of repression is somewhat more 
questionable, but it, too, was meaningfully re- 
lated to another variable in that it was in- 
versely associated with over-all expressive- 


s a degree of 
hough there is 


tion might be ra 
that overestimate 
sidered as low i 


group that underrated 


5 the re 
equally negative, , sults are 


One explanation of the negati 
repression and humor is that ti 
eral relationship between repressed hostilit 
and preference for hostile cartoons. That 
there might be a relationship between re- 
pressed hostility and a preference for Certain 
types of hostile cartoons was suggested by 
the results on a cartoon of the Practical-joke 
type which depicted an unprovoked act of 
hostility. However, the evidence here was in- 


ive findings on 
here is no gen- 
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clusive and verification is required. A second ' 
possibility is that a relationship would be 
found if suppression (conscious inhibition) 
or external frustration of an impulse were in- 
vestigated rather than repression (uncon- 
scious inhibition). This, too, remains to be 
determined, but seems likely in view of com- 
mon observations of the interest in sexual 
jokes of sexually frustrated groups such as 
adolescents (culturally frustrated) and men 
in the armed services (geographically frus- 
trated), who are not necessarily repressed. 
third possibility for investigation is that a re- 
lationship between repression and humor be- 
comes manifest only when repression reaches 
pathological proportions (10). 

Insight and humor. Allport states, 
the most striking correlate of insight is the 
sense of humor” (2, p. 222). He cites one 
study in which a correlation of .88 was foun 
between ratings on insight and ratings °” 
sense of humor. In the present study it we 
found that there is a statistically significan? 
relationship between rating the cartoons cor 
rectly and judging one’s hostility accurately: 
Why are insight and humor related? Althous® 
there was no way of testing this in the pe 
ent study, it is hypothesized that the two a" 
related only when humor involves an abii 
to accept the self as its object. Presumab A 
the person who is able to laugh at his limita- 
tions should be low in defensiveness an be 
cordingly should be insightful. It would = 
interesting to develop a measure of a 
tial appreciation of humor in which the k A 
ject of some of the jokes or cartoons is Sê is 
related and of others is other-related. a 
measure might then be related to nl ie 
of defensiveness and insight. Perhaps 4 sub D 
clinical instrument for determining defensi” 
ness and insight would result. 

An incidental finding of some interest el 
that there are individual differences in pan 
and type of expressive reaction irrespect 
of the content of the cartoon responde 
This finding indicates that it is necessary e 
use control cartoons in evaluating differen’ e 
In expressive reaction to any particular brie 
of cartoon. It further indicates that indivi o 
differences in expressive behavior, apart #° jt 
the nature of the cartoons responded t0, å 


“ 


was 


a 


—— Ss 
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‘self a promising personality variable for in- 


vestigation. 
Summary 


Preference for hostile humor was measured 
by three techniques, which included observ- 
Ing S’s expressive reactions to hostile and 
Control cartoons, having S rate the cartoons, 
and having him sort them on a Q sort of 
funniness. In order to obtain a measure of 
pcs tession, the Ss, members of the same fra- 
ternity for at least a year, rated themselves 
and each other on a Q sort of hostility. The 

gree to which the self-rating was lower than 
i average rating by others was taken as an 

ex of repression; the absolute discrepancy 
meen the self-rating and rating by others 
oT taken as an index of insight. Three groups 
Slew each were selected, a group that con- 
ite oe overestimated its hostility, an accu- 
its hone that very slightly underestimated 
ni Ostility, and a group that considerably 
the €testimated its hostility. Following are 
Major findings: 
monet relationship was found between a 
a and general preference for hostile 
Ons, but there was questionable evidence 
ap repression was related to preference for 
pra tical- joke type of cartoon depicting an 

3 voked act of hostility. , 
significant positive relationship be- 
sight and sense of humor was found. 
twee Significant negative relationship be- 


en ” ae 
foung, Pression and degree of reactivity was 


tween in 


4. p: : , 
des. Highly reliable individual differences in 


a ki . . 
spect and kind of expressive reaction Irre- 
foung of the cartoons responded to were 
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Implications for further work on the rela- 
tionship of humor to repression and insight 
were discussed. 


Received January 9, 1956. 
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The Meaning and Generality of Perceived 
Actual-Ideal Discrepancies 


Leon H. Levy? 


Indiana University 


Recent studies by Rogers (4) and his asso- 
ciates have revealed that when subjects (Ss) 
are asked to do Q sorts of self-referent items 
under instructions to sort them so that they 
describe themselves as they are at present 
and then again so that they describe their 
concept of the ideal person, the correlation 
between these two sorts seems to vary with 
the presence or absence, or severity, of mal- 
adjustment. The size of the correlation þe- 


tween actual- and ideal-self-sorts has been 
interpreted variously as 
esteem or self- 


discri 

concept of self aa et Parte fie 
(1, p. 257), 

However, upon careful analysis of the pro- 
cedures and data involved in these experi- 
ments it does not appear that these infer- 
ences are entirely justified. In this paper we 
propose to examine the lo 


; gical justification 
for these inferences and the 


$ n to present data 
supporting an alternate hypothesis, 


The task set for the S in the typical actual- 
ideal Q-sort study is one of describing one 
aspect of his environment as he perceives jt 
in its actual state and again as he perceives 
its ideal state to be. The resulting correlation 
may be interpreted as an indication of the 

1The author wishes to thank Mr, 


Gundy who ran the Ss and performed 
computations. 


Richard F, 
the statistica] 


d 
perceived discrepancy between the an 
ideal states of the particular aspect of i ex- 
vironment delineated for the S by the tive 
perimenter’s instructions and the PEA re- 
items he has to work with. In the ee 
ferred to above the aspect of the me o! 
involved is labeled “the self” and a E as 
verbal items deemed by the ezper me on t0 
appropriate in describing the self func nmen 
delineate that aspect of his total enviro eive! 
for which the S is to indicate his perc 
actual-ideal discrepancy. >a of the 

The finding that a certain portion ny be 
variance of the discrepancy measure ™ s not 
attributable to individual differences o con- 
in and of itself permit any E as- 
cerning the significance of the parne inini 
pect of the environment used in 0 ntil Ít 
this discrepancy measure. That oe sl cor- 
has been demonstrated that sane ge 
relations vary with adjustment if an the self 
they are obtained through the use of g cone 
as the object of description, inference of the 
cerning the importance of the naa 
self concept in personality functiona the 
not justified. It may be, for example, rea 
more maladjusted the individual the S e 
the discrepancy he perceives betwee" ide 
actual and ideal state of affairs over 4 con 
Tange of areas of his environment. at 4 
ceivably, one might discover a significa y 1 
lationship between Q correlations for te av! 
ideal descriptions of geographical climen of 
Personality adjustment. Unless one Miror 
to sample other aspects of the S’s € be 
ment as objects of description he mig 
led to construct a theory of personality 
tioning with climatological perception 
Central construct. 


une 
ma 
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Generality of Perceived Actual-Ideal Discrepancies 


The hypothesis which we propose to test 
in the present study is that individuals differ 
in the extent to which they perceive discrep- 
ancies between the actual and ideal states of 
Various aspects of their environment and that 
these differences are fairly constant from one 
area to another. Thus an individual obtaining 
a high Q correlation when doing actual-ideal 
Sorts of self-referent items would be expected 
to obtain a high Q correlation when doing 
actual-ideal sorts of items descriptive of other 
aspects of his environment, and similarly 
With an individual obtaining a low Q correla- 
tion between actual-ideal self-sorts. 


Procedure 


The Ss used in this experiment consisted of 
- Volunteers (2 females and 19 males) from 
n introductory psychology course, none of 
om were aware of the nature of the ex- 
eet at the time of their volunteering 


to Each g was seen individually and was asked 
i do actual-ideal sorts of 100 self-referent 
ms and of 100 home-town-referent items. 
€ seli-referent items were those developed 
ret Butler and Haigh (2).2 The home-town- 
„erent items were collected in the follow- 
Det Manner, Twenty students in the author's 
‘sonality class were given the following 10- 
"Uuctions: “(@) List five things that you like 
thine about your home town. (b) List five 
tome that you like least about your home 
Would (c) List five things which you fee 
e be true of the ideal home town. From 
lect resulting pool of 300 items, 100 were Se 
Pli ed which appeared to have fairly wide ap- 
“ability and which provided an approxi 


SI ezb. 
haat equal representation of positive and 


lve statements. 
ments Ss were required to sort the a 
De each sort into nine piles with A 
ae distribution of cards per pile: 1, 4, 
Sent 1, 26, 21, 11, 4, 1. Each S was first pre- 
asked. with the self-referent statements and 
as h to sort them so as to describe himself 
li = Sees himself at present from those least 
lovja Mself to those most like himself. Fol- 
ng this he was asked to sort the home- 


2 
X a 
monge author wishes to thank Dr. Rosalind F. Dy- 
or making these items available for this study. 
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town-referent statements so as to describe his 
own home town. Next he was asked to sort 
the self-referent statements again so as to de- 
scribe his ideal person, or the person he would 
most like to be. And finally, he was asked to 
sort the home-town-referent statements so as 
to describe his concept of the ideal home 
town, the kind of town he would most like to 
live in. The same order of presentation was 
used with all Ss. 

The two Q correlations resulting for each S 
were then correlated over all Ss in order to 
determine the extent to which actual-ideal 
discrepancies in the two areas sampled were 
related. 


Results and Discussion 


The median Q correlation for actual-ideal 
self-descriptions was .47 with a range from 
08 to .82. The median Q correlation for 
actual-ideal home-town descriptions was .24 
with a range from — .28 to .92. The Pearson 
correlation between the two sets of Q correla- 
tions was .70 which is significant at the .01 
level. This finding makes the null hypothesis 
untenable and gives some support to the ex- 
perimental hypothesis that the Q correlation 
obtained for an individual on actual-ideal 
self-descriptions represents a tendency to per- 
ceive actual-ideal discrepancies which tran- 
scends the particular aspect of the S’s envi- 
ronment used as the object of description. 
Furthermore, in the light of the present data, 
previous hypotheses concerning actual-ideal 
discrepancies which treated them as phe- 
nomena contingent upon such conditions as 
self-acceptance, self-esteem, self-satisfaction, 
etc., appear to be too narrowly conceived. 

While the self concept as an important con- 
struct may still be salvaged by invoking the 
processes of projection and rationalization on 
the part of the S to account for generalized 
perceived actual-ideal discrepancies, particu- 
larly in the case of maladjusted individuals, 
such reasoning must be recognized as ad hoc. 

In the present study only two aspects of 
the Ss’ environment were used as objects of 
description. Before any definite statement can 
be made about the generality of perceived 
actual-ideal discrepancies many more aspects 
would need to be sampled. It would appear 
however that research might be profitably di- 
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rected toward a study of the nature and ex- 
tent of perceived actual-ideal discrepancies. 
Certain rather interesting research prob- 
lems become opened up by such an approach 
and it may be of some value to sketch these 
briefly. One such problem would be: Given a 
certain number of objects of description, do 
individuals vary in the consistency of their 
perceived actual-ideal discrepancy over the 
range of these objects? What factors might 
best account for the variance in this con- 
sistency? What factors, if any, appear to be 
a function of the degree of perceived actual- 
ideal discrepancy in any given area of de- 
scription? Do these vary from area to area? 
The theoretical implications of such research 
are difficult to anticipate but it seems fairly 
clear that current self-oriented neophenome- 
nological personality theories (3, 5) would 
not be adequate to account for these data, 


Summary 


n for current inter- 
ideal self-description dis- 
led into question, An ex- 
formed in which Ss did 
actual-ideal Q sorts using self-referent items 
wn-referent items. The Te- 


Leon H. Levy 


sulting sets of correlations were found to a 
a statistically significant correlation of 70 
tween them and this was taken as vice 
indicating a certain amount of generaly P; 
perceived actual-ideal discrepancies and m 
ther substantiating the criticism of wr 
interpretations of these discrepancies wh À 
limited to the self as the object of Ba 
tion. Implications of these findings for fu 
research were sketched briefly. 


Received December 5, 1955. 
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Learning in the Immediate Post-Electroshock Period’ 


George A. Zirkle 


Hanover College 


The view has been current for some years 
that the period soon after electroconvulsive 
Shock offers unique opportunities for psycho- 
therapy with mental patients. Though many 
Clinicians have used the period rather exten- 
Pi for this purpose, others have ques- 
ee its value. For instance, Kalinowsky 
nd Hoch write, “In our experience, need 
erapy during convulsive therapy has often 
“in impossible because of the patient’s con- 
usion’” (3, p. 118). 
fea valuable is the postshock period for 
ie otherapeutic purposes? If it is valuable, 
e oo after shock should psychotherapy 
e stituted? Answers to these questions will 
0 ne among other things, on an analysis 
Steere Mental state of the patient after dis- 
im hizing shock, and a determination of the 
© pattern by which abilities are recovered. 
rotted ber of research efforts have been di- 
cone, toward this end, most of which have 
bea on memory functioning. Certain 
cide watts (1, 5, 6) have reported a de- 
Perim interference of shock with memory. Ex- 
eral he ntal testing has usually been done sev- 
imm Ours or more after shock, rather than 
i g diately afterward. An example of work 
is that immediate postshock period, Bowen, 
me at of Lunn and Trolle (4), who studie 
ntal abilities 10, 30, and 60 minutes after 
ey They note very poor retention hes 
min S presented shortly after shock. Thirty 
Utes afterward, however, they report that 
“a Per cent of their patients were able to give 
Satisfactory description of the content of 
Picture and at the same time express 2 Com- 
inten cooperation of Ott B. McAtee, M.D. pel 
Mtendent. William E. Murray, M.D, ener 
a Makin and the staff of Madison State pie 
Ereby g their facilities available for this study 
8ratefully acknowledged. 


prehension of the point of the picture” (4, p. 
376). 
The Problem 


Up to this time, relatively little research 
attention has been given to one of the crucial 
factors in the ability to profit from psycho- 
therapy—namely, learning. This is especially 
true of learning in the immediate postshock 
period, when psychotherapy is often insti- 
tuted. As a partial answer to this lack of in- 
formation, the present research was designed 
to study, under controlled conditions, the 
pattern for recovery of learning ability after 
shock. 

One possible, and no doubt partial, inter- 
pretation of the therapeutic effect of convul- 
sive shock is that it temporarily disrupts or 
disorganizes abnormal mental patterns and 
permits the substitution of different patterns 
of a more normal or healthy character. We 
are well aware of the fact that a startling 
event can shock a normal person “out of his 
complacency” and cause him to see familiar 
things in new ways. It may be that convulsive 
shock does somewhat the same thing for the 
abnormal person, and jolts him out of his 
“psychotic rut.” If this line of thought be 
followed, then it would appear that the opti- 
mum time to substitute new patterns of 
thought would be at the point where disor- 
ganization is great enough to permit their in- 
troduction and yet where learning ability is 
sufficiently recovered to permit their reten- 
tion. In other words, if the above interpreta- 
tion has any validity, the best time for a re- 
educative therapy would be as soon after 
shock as a reasonable degree of learning 
ability has returned. 

Subjects. Subjects in this investigation were 
five female and three male patients at Madi- 
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son State Hospital who were receiving elec- 
tric convulsive therapy. They were all liter- 
ate, in relatively good contact, and coopera- 
tive. Their ages ranged from 27 to 62, the 
average being 37.1. Six were schizophrenic, 
one manic-depressive, and one involutional. 
Experimental materials. Three types of 
learning materials were developed and used 
—pictorial, verbal, and numerical. To test 
visual object learning, a series of 16 line 
drawings was prepared. Each drawing con- 
tained a mannikin surrounded by certain ob- 
jects. Fifteen details were catalogued in each 
picture, such as type of hat, tie, etc. on the 
mannikin, and house, balloon, and other ob- 
jects surrounding the mannikin. Five differ- 
ent objects or conditions were systematically 
varied at each of the 15 locations on the dif- 
ferent pictures. For instance, the objects on 
the right side of the mannikin were a bicycle, 


a truck; and 
S shown vari- 
TS Up, Corners 
and the other 


called to his atte 
he remember as 


An example was, “Interests outside make a 
person far happier inside,” Patient motiva- 
tion for the task was good and several seemed 
to enjoy it. Indeed, Success with this pro- 


cedure would seem to dictate its wider use as 
a measure of learning ability. 

To test verbal learning, 16 lists of paired 
adjectives were developed. Each list contained 
11 pairs. They were obtained from a list of 
300 pairs developed by Melton and Safier 
(2), and were relatively equivalent in terms 
of the similarity ratings given them by 96 
university students. A list was slowly read 
over once to a subject with the instruction 
that he should try to remember as many of 
the pairs as possible, Thereupon he was 
handed a typewritten list containing the first 
adjective in each pair ranged on the left 
margin, and on its right the second member 
imbedded among three other synonymous 
adjectives. For instance, the pair Pleasing- 
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Charming, appeared on the typed list given 
to him as follows: Pleasing: Pleasant, Gra- 
cious, Charming, Winning. The subject was 
asked, “Which word did I read with Pleas- 
ing?” The same procedure was employed with 
each of the other pairs. i 
To investigate numerical learning, a series 
of 16 lists of numbers was prepared. Each 
list contained two samples each of two-digit 
through eight-digit numbers, arranged as in 
the Wechsler-Bellevue Intelligence Scale. 
Starting with the shorter numbers, subjects 
were asked to repeat each one immediately 
after it was read to him. His score was the 
highest number he could accurately repeat- 
No attempt was made to go further when 
both samples of a given length were failed. 
Procedure. Subjects were enlisted by &* 
Plaining to them that they had been chosen 
for a series of memory tests. One practice 
trial was given on each of the three types ° 
materials to familiarize the subject with the 
Procedure. The order of presentation Was 
Picture, paired adjectives, and numbers. 


i ject 
A control series of tests was run with each subje 


one to three days before shock was begun. pun $ 
the three types of tests were given six different m 
Some hours to a day intervened between the . A 
three and the last three runs. A short break © 
minute or so was introduced between runs. fter 
Experimental testing was begun as soon 4 to 
shock as the patient was able to get up and E er 
a nearby examining room. Two runs of tests W' 
given in succession, A third run was given after ed 
patient had had lunch. This procedure was fonon 
after three shocks—in practically all cases the a 
three. This made a total of 9 experimental runs 
compared to 6 control runs. Runs were rotate T 
that four subjects got the test series in the orde er. 
to 15, and the remaining four in the reverse oig 
The time for beginning of experimental tes 
after shock varied from 10 to 30 minutes, witb a- 
average for all subjects of 184 minutes. Several Ef 
tients became nauseated, showed confusional Lage 
tion, or displayed paranoid resistance. 
caused testing delay, 


Results 


Table 1 shows clearly the effect of i 
on learning performance. A profound hee 
ference with learning ability is shown in r- 
first test run after shock, which was an ar 
age of 18} minutes later. The critical mng 
of differences between experimental and e 
control means are highly significant except 


ç 
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Table 1 


Scores on Control and Experimental Series 


Control runs 


Experimental runs 


Test and measure 1 2 3 Total 1 2 3 
15 Mannikin Items 
ean 10.8 11.3 11.4 11.2 25 8 
t $ E 2 E 3 2: 
Percentage of success 72 75 76 15 17 55 81 ? 
i 2.21 2.96 2.87 2 
CR with control total 12.39 4.23 im 
5-Poj ae 
ie Mannikin Aphorisms 
Mean 3.6 2.7 3.2 3.2 4 1.8 3.4 
sa antage of success 72 54 64 64 8 36 68. 
i 1.87 1.26 1.87 
CR with control total 7.26 2.89 “i 
u Naired Adjectives 
Mean 7.6 7.3 8.6 7.8 4.5 5.5 iff 
Sp tee of success 69 66 78 71 41 50 70 
D 2.47 1.66 2.22 2.03 
with control total 66 3:99 = 
“Numbers 
pan 6.1 6.1 6.0 6.0 5.9 6.0 6.5 
gp t38 of success 76 76 75 75 74 75 81 
ae 93 1.38 1.23 1.04 
R with control total 7 = 1:26 


the 
c ‘ P r 
ase of numerical learning. Interference is 


No! 

t i aS but still significant degree on 

Case of A experimental run, except in the 

ing an paea learning. The second test- 

later, L egan an average of 38} minutes 

Preshocke ae performance has returned to 
ich w. evels by the third testing run, 

as an average of 2% hours later. 


Discussion of Results 


I . 
ki 1S clear from these results that electric 
abilities oloundly interferes with learning 
a Stract Greater interference is shown for 
Th mo than for more concrete materials. 
e, extensive interference occurred in 
Most ab of the aphorisms, which were the 
stract materials used in this experi- 
only uring the first test run after shock, 
ber ae Persons of the eight could remem- 
two fied Part of the aphorisms. One of these 
ed aS not be tested until 30 minutes 
M the ock. The least interference occurred 
This o of numerical learning and report. 
tac represented the lowest degree of 
lon. Hetherington (1) also found 


little influence of shock on immediate num- 
ber recall. 

Learning was measured in this experiment 
by means of immediate report. No attempt 
was made to determine whether materials 
were retained over a longer period of time. 
In a re-educative therapy program, long-term 
retention would be necessary, of course. 

So far as learning ability is concerned, it 
would appear highly unprofitable to attempt 
a re-educative type of therapy immediately 
after shock. This is deduced from individual 
as well as group scores. While individual 
variations in recovery rate were smoothed by 
combining them to produce a group picture, 
all individual patterns of recovery closely 
paralleled the group pattern. 

By two to three hours after shock, results 
show that learning ability has returned to 
preshock levels. It is quite probable that con- 
trol level ability may return even earlier 
Timing for the third test run was set at the 
completion of the lunch hour for patients 
and so this was not determined. The shortest 
tient on the third run of tests was 1 hour and 
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55 minutes after shock. In this one case learn- 
ing ability was back to preshock level. 
Insofar as present results are concerned, 
re-educative therapy is contraindicated for 
most patients during the first hour after 
shock. Recovery rates varied for different pa- 
tients, but preshock learning performance is 
recovered somewhere between 1 hour and 23 
hours after shock. According to the theory 
enunciated earlier in this article, somewhere 
within this interval would seem to be the 


optimum time for the institution of re-edu- 
cative efforts. 


Summary 


Using pictorial, verbal, and numerical ma- 
terials, the learning ability of eight mental 
patients was tested both before and at stated 
intervals immediately after administration of 
electroconvulsive shock, Results showed a 
profound interference of shock with learning 
ability. Interference was greater for abstract 
than for more concrete learning materials, 
Learning abilities were recovered in a gradual 
fashion, with preshock level being restored 


George A. Zirkle 


not later than two to three hours after a“ 
Implications of the results for a re-educativ' 
type of therapy are noted. 


Received January 3, 1956. 
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Note on “Changes in Psychoneurotic Patients 
With and Without Psychotherapy” 


Desmond S. Cartwright 
University of Chicago 


ae m paper in this Journal by Barron 
chan eary (2) reports a comparison of 
Hen in a treatment group of psychoneu- 
group oe with changes in a nontreatment 
Seventh roups were matched for type and 
variabil. of disorder, prognosis, socioeconomic 
test €s, and interval of time between pre- 
S and posttests. 
Bia patients in treatment, 42 received 
ta ual and 85 received group psycho- 
salen The measures employed were MMPI 
Yong Aiding a prognostic scale (Es) de- 
showed by Barron (1). _ The crucial data 
en mean differences in scale scores be- 
ES petes and posttests. Comparison of 
ition by critical ratio analysis led to the 
“sion that: “The therapy patients did 
oe significantly more than did the 
ng-list controls” (2, p. 245). 
pa IS conclusion answered the question: 
tegulas there significantly more change with 
an and formally defined psychotherapy 
Without it?” (2, p. 245). Statistically, 
answer given states that the treatment 
to . g reatment samples must be considered 
in We from the same parent population 
enc rd to mean changes. The presence or 
oe, of psychotherapy makes no difference. 
vever, from the data presented (2, p- 
: lt appears that the samples differ as 
senga persion of changes (SDs). Table 1 
Psycho relevant data for the individual 
toup erapy group and the nontreatment 
the 2 together with F ratios computed from 
ariances, 


a 
the Ps 1 suggests with high probability that 


Wi 
Parent, Samples are not drawn from the same 
Population in regard to the variance of 


Wait 


Si 


24 
to ¢ 
Pre. 


changes on scales F, Hs, D, Pt, Sc, and Es. 
This means that the presence or absence of 
individual psychotherapy makes a consider- 
able difference. 

The implication of the results in Table 1 is 
that in fact there was “significantly more 
change with regular and formally defined 
psychotherapy than without it.” 


Table 1 


Variances of Discrepancy Scores on MMPI Scales 
for Individual Psychotherapy and 
Nontreatment Groups 


Individual Nontreatment 
psychotherapy 

(V=42) 
MMPI 
Scale y“ F b 
1. Lie 19.89 1.18 — 
2r 215.21 9.38 01 
3. K 55.95 1.76 — 
4. Hs 127.46 1.99 05 
S.D 244.30 2.62 01 
6. Hy 113.21 1.29 — 
7. Pd 155.00 1.73 — 
8. Pa 111.94 1.64 — 
9. Pt 208.51 2.85 01 
10. Sc 272.91 3.68 01 
11. Ma 126.79 1.68 — 
12. Es 43.56 2.94 01 


* Variances computed from SD data reported by Barron and 
Leary (2, p. 243). 


The greater amount of change, however, 
was not all in one direction. Thus the au- 
thors’ conclusion that “The therapy patients 
did not improve significantly more than did 
the waiting-list controls” is correct but `in- 
sufficient. For many scales the variance re- 
sults suggest that mean differences between 
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the groups are absent because differences of 
two kinds, opposed in sign, are Present. It i, Baeroi Wa At egorstrengih. sale whith pects 
seems that some therapy Patients deterior- response to psychotherapy. J. consult. Psy- 
ated to a greater extent than did the waiting- chol, 1953, 17, 327-333. 

list controls, while some therapy patients did 


2. Barron, F., & Leary, T. F. Changes in psycho- 
improve significantly more than the controls. neurotic patients with and without psycho- 
therapy. J. consult. Psychol, 1955, 19, 23% 

Received November 9, 1955. 245. 
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A Short Form of the Wechsler-Bellevue and 
the Army Classification Battery as 
Measures of Intelligence’ 


Donald B. Murphy 


Army Medical Service School, Ft. Sam Houston, Texas 


and Robert D. Langston 
Br. U. S. Disciplinary Barracks, Ft. Crowder, Mo. 


Se ugh the Army Classification Battery 
ave Lot forms of the Wechsler-Bellevue 
a ayy used as measures of intelligence, 
plication of the literature indicated the ap- 
to an oa previously published short forms 
tion w rmy disciplinary barracks popula- 
ent Ped somewhat questionable. The pres- 
lidity s 4 was designed to investigate the va- 
Ptitud a short form of the W-B and of 
Cation k, Area I (AAI) of the Army Classifi- 
is „ attery as measures of intelligence for 
Population. 
nse present study, the records of 515 
Ciplina ive releasees from the Br. U. S. Dis- 
ere a Barracks, Ft. Crowder, Missouri, 
Dries ed, The ages of this group of male 
falling TS ranged from 16 to 41 with the mode 
Per ig the 20-24 age grouping. Eighty-five 
Cupar reed at unskilled labor or had no 
Priseq Me prior to induction. Negroes com- 
Th 0% of the group. 
based W-B full scale IQ, short form IQ 
and p on the Information, Comprehension, 
the ock Design subtests, and the scores on 
» Which has a normative population 
100 and SD of 20, were obtained 


f of 
Or each case. 
wae report of this study may be ob- 
th S, Ft out charge from Capt. Donald B. Murphy, 
is, Americ Sam Houston, Tex., or for a fee from 
fron the la n Documentation Institute. To obtain it 
ty poiter source, order Document No. 4970 
to Plication Auxiliary Publications Project, Photo- 
file 25, Service, Library of Congress, Washing- 
to KF $1 a remitting in advance $1.25 for micro- 
Rr Chief P for photocopies. Make checks payable 
ess, > Photoduplication Service, Library of Con- 


l 
. An 
tained 


The mean of the full scale W-B was 93.2 
with an SD of 16.1; the mean of the short 
form was 92.8 with an SD of 16.9; and the 
mean of the AAI was 81.7 with an SD of 
22.2. The short form of the W-B and the 
AAI correlated .91 and .83, respectively, with 
the full scale W-B. 

The advantage of the short form, since it 
is a reliable predictor of full scale scores, is 
that testing time is reduced, permitting rapid 
processing and more time for evaluation of 
nonintellectual factors. 

The Ss used in this study had a signifi- 
cantly lower IQ (p < 01) than Wechsler’s 
normative group and differed from Wechsler’s 
population with respect to occupational status, 
education, and race. It is interesting to note 
that the short form used in this study has 
been reported to have the highest correlation 
with the full scale W-B for Wechsler’s norma- 
tive group, thus indicating the stability of 
these subtests despite differences in socioeco- 
nomic, educational, and racial backgrounds. 

The mean for the AAI was significantly 
lower (p < .01) than the AAI mean (90.7) 
estimated on the basis of the Ss’ W-B scores. 
Marked increase in the variability of AAI 
scores below 75 suggested that many of the 
low scores resulted from poor motivation at 
the time the test was administered rather 
than from low intelligence. When AAT scores 
below 75 were discarded, the mean of the 
AAI scores (93.4) closely approximated the 
estimated AAI mean and correlated .88 with 
the full scale W-B. 


Brief Report. 
Received April 3, 1956. 
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“Reliability of the Blacky Test”: 
A Reply to Charen 


Gerald S. Blum 


University of Michigan 


After reading Charen’s brief report on the 
retesting of 25 tuberculous patients, printed 
in the February issue of this Journal (5), I 
was left with two major misgivings: (a) the 
title is a misnomer inasmuch as the technique 
was used improperly; and (b) the author’s 


reasoning is faulty. I shall elaborate these 
points below: 


1. The Blacky Pictures are designed to 
yield conflict scores for a series of psycho- 
sexual dimensions. As stated in the Manual 
(3), four separate Sources contribute to each 
ous story, inquiry 
nd cartoon prefer- 


€ technique was 


i ly, since Spontaneous 
stories were not obtained Prior to the re- 


sponses to multiple-choice items, 
2. From the facts that the Rorschach and 
paper-and-pencil tests indicated no 


aye i “basic 
changes” in personality whereas the Blacky 
items did show some (basic?) changes 


ons tapped person- 
y the other tests or 
did not have good reliability.” He rejects the 


first alternative by a statement of faith in the 
Rorschach. I prefer to call upon evidence con- 


tained in a study by Berlow (2), who es 
pared Blacky scores (in a sample of oe 
whose responses had previously been ail 
ingfully related to theories of paranoid Sp eo 
Phrenia [1]) to psychosexual rena to 
the Rorschach. In addition to using me 
assess psychosexuality from the Rorsc aie 
Berlow conducted a systematic and ait 
tive analysis of signs, patterns, and ake 
No significant relationships to the ~ the 
were established. Had Charen employe rear | 
Blacky correctly, there would still be ene 
Son to expect congruence with R ade? 
findings. Berlow’s results are not a 0 
to set off a debate on the relative ao out 
the two instruments, but simply to pojn i 
that there is no place for the Rorscha 
Blacky’s orbit of construct validation. pat 
Finally it is important to keep in min 
even when the technique is pamini ect- 
utilized correctly, the retest method, anges 
ing as it does an unknown mixture of € haps, 
in set, familiarity with items, and P' A erly 
Personality changes as well, cannot Pr pnses 
be employed to study reliability of resp 
to the Blacky Pictures. 


Received March 23, 1956. i 
Early Publication by the Editor. 
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A Reply to Blum 


Sol Charen 
Montgomery County Mental Health Clinic, Rockville, Maryland 


wees Pinpoints emphasis on my title to 
hase the technique I used is incorrect. 
hana is only intended to furnish brief infor- 
“on a an article. Mine could have 
the A as It is also necessary to read 
not R to find out what it is about and 
throu 2 solely on the title. Clearly stated 
of the ie my brief report, “The Reliability 
With th acky Test,” is the fact that it deals 
quest; e low reliability of the multiple-choice 
lons of the Blacky test, as found in my 


oe Tal research (2). This is all my article 
lum With, not the total Blacky test, and 
When is unwittingly in accord with my text 
Choice € states in his reply “. . multiple- 
Closest items from the inquiry, . - - [are] 


Easily Phe consciousness and, therefore, most 
out, th istorted by the subject.” As he points 
wish ee the multiple-choice questions do 
tribute One of the four sources which con- 
ion of to each dimensional score. The ques- 
therefo reliability of the total Blacky test is 

re involved when a major score source 

l i e questionable. ; 

Ce spontaneous stories were not obtained 
hot hal, chronically ill patient subjects I did 
affecte, PW his technique. How this omission 
ions their responses to the multiple ques- 
Blum or each cartoon I do not know. But 
that tha, on shaky ground when he implies 
abilit 1S omission somehow affected the reli- 
his nd since he has no reliability studies of 
Of its n for either the total Blacky test or any 
is ti scoring sources. Without such data, 
om;.SU™Ption is purely hypothetical that the 
on of the spontaneous stories somehow 
a the reliability in the test-retest 
tion, 

a has lifted a sentence out of context. 
Validat £ did I use the Rorschach test to 
Plec € either the Blacky test or its multi- 

Oice items. The Rorschach and fifteen 


paper-and-pencil tests were used to evaluate 
whether my patients in a four-month period 
showed test evidence of basic personality 
changes as a result of chronic illness and ex- 
tensive hospitalization. No test evidence of 
such changes was found. Only the multiple- 
choice items of the Blacky test indicated that 
some changes took place in my experimental 
subjects. These, in general, suggested they 
were nonregressed during illness testing and 
were regressed when retested shortly before 
discharge from the hospital. I believe I am 
consequently justified in assuming that the 
equivocal results found in the Blacky multi- 
ple-choice items may have been due to the 
factor of the low reliability which was found 
to exist. 

One final comment about the last para- 
graph of Blum’s reply is in order. The ques- 
tion of set should not be involved in the 
Blacky test as it might be in other person- 
ality tests since his scoring allows for evasive- 
ness or attempts to use defenses. Familiarity 
with items is not likely to be a problem when 
a four-month or longer period elapses be- 
tween the test and retest. Finally, since the 
Blacky test purports to measure, “the deeper 
recesses of personality” (1), namely the ge- 
netic psychosexual dimensions which should 
not change in the individual unless psycho- 
analysis or a marked life experience occurs, 
personality change is also not a factor which 
should prevent use of the retest method. 


Received June 25, 1956. 
Early publication by the editor. 
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PSYCHOLOGICAL 
TEST igg IEWS 


Doll, Edgar A. Vineland Social Maturity Scale. Min- 
neapolis: Educational Test Bureau, 1947. 


Reviewed by 


Morris Krugman 
Board of Education, New York, N. Y. 


scoring 


sented for general use, 
Vineland Social Maturit 


presented for each ite 


and CRs supplied. Line drawings ill 


behavior are added. Q; 


ment of data was Overelaborated, si 


level from 0-1 to 30, a total of 


The scale is too well known to re. 
scription here. Briefly, it consists of 117 i 


self-help (general, eating, and 


tion, occupation, communication 
socialization. “Each item is conceived as re 


more than a hundred titles 


- For the first time 
the details of the 
samples, methods of 


Pertinent data usually sup- 


ustrating typical 
ether the treat- 


females at each 
620 Subjects, 


quire detailed de- 


age 


Presenting 


a general growth in social responsibility which is ex- 


pressed in some detailed perfo; 


Tmance as an overt 


e 
am ntly, th 
expression of that responsibility. Conseque 


ined prn- 

value of the detailed items is to be e this pe 
cipally by the extent to which they ities, in respec 
sonal independence in personal activi age otherwise 
to which the detailed performances eflect progres- 
relatively unimportant.” The items r direction, ° 
sive freedom from need of assistance, 5 
supervision on the part of others. sacitner 33 

Although direct rating by the ee knowing 
ruled out if opportunity for ecg of use ® 
the subject is available, the usual m thoroughly fe 
by interviewing an informant yea The fact that 
miliar with the behavior of the per need not p 
the subject being examined and ra a and a d é 
Present or observed is both an lap maces a 
advantage. The obvious advantage sels ally mature 
plying the scale by questioning a incompetent 0 
competent adult about an immature, tage lies in je 
handicapped individual. The qisgavan taen aE rati 
possibility of gross distortion and = z feeling. 9 
The reviewer has always E the su n 
greater confidence about ratings w. ating bY men 
Was seen even briefly after the usual a of the so? 
of an informer, and ve a few ite at 
have been spot checked. r bout a 

Usually, the publication of basic Sie d streng A 
cal instrument serves to clarify eee) the case W js 
the use of the instrument, This is TREY the soal i 
the Vineland Social Maturity See any differs 
a very useful clinical adjunct wit! the almost wy 
types of subjects is attested to bin past twe ad 
formly favorable literature over any years oat 
years. This reviewer has used it for m respect is ipe 
has tremendous respect for it. But ma, manual. a 
increased by careful reading of the A Gad been set 
small number of cases at each level the ear ic 
tioned and indeed was known ek grap, 
manual, but the elaborate statistical aie since ob 
treatment of each item is not convin aisal OF © nd 
spite of the fact that continued appr entally, an 
item was made Statistically, alae been shi ae 
clinically, not one of the 117 items een or One 
up or down, nor have items been rep. er end of ants 
fied. Equally questionable is the uppi r adoles¢ pis 
scale, intended for normal and superio. e data, “of 
and adults. Although based on ae a e ie 
Part of the scale could well be an, ext rdly ™ jo 
the lower end of the scale, and it ha defect’ 
sense. An ingenious method of measuring 
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Social maturation of children and adults, and indi- 
cating the level of social development of children 
pio are not necessarily retarded in development, 
e Vineland Scale is artificial when applied to nor- 
rom Or superior adolescents or adults. Most users of 
e scale simply ignore the upper levels. 
Ehe Vineland Social Maturity Scale has its great- 
t usefulness in distinguishing between real and 
social feeblemindedness, in providing a measure of 
devel development in studies of child growth and 
Eon opment, and in appraising levels of social func- 
among handicapped individuals of many kinds 
ce Many types of pathology, particularly in 
a of arrested development or deterioration. It 
aria a permanent place for itself in clinic and 
of oae and newer approaches to the appraisal 
it. Th T maturity have not succeeded in replacing 
modes act that it has not been found necessary to 
Year y or “improve” the scale over these many 
TS can be accepted as evidence of the carefulness 
which it was originally constructed, and the 
oi eal insight that obviously determined the 
Construction and standardization. 


keen 


D 
a Edgar A. Vineland Social Maturity Scale. Min- 
apolis: Educational Test Bureau, 1947. 


Reviewed by 


Edwin S. Shneidman 
VA Neuropsychiatric Hospital, Los Angeles 


choi ielan Social Maturity Scale is not a psy- 
iew ie test in the usual sense, nor does this re- 

S nd to be the usual type of test review. 
ceiving Sts are samples of modes of reacting, per- 
Ments A adjusting, or are extrapolations from seg- 
a behavior. The Vineland Social Maturity 
a the other hand, attempts to measure be- 
a irectly, Although Doll says that “The scale 
n mere rating scale and scores are not to be based 
Would efihia” (italics his), nevertheless the scale 
Same ge em to be in the same tradition and of the 
Malamud, as the Gesell Development Schedules, the 
Ferguson- ma Sands Psychological Rating Scale, the 
The Vinel cReynolds Hospital Rating Scale, etc. 
(to mor and Social Maturity Scale is a well known 
Of the © than one generation of clinicians) measure 
Copi, Social and adaptational skills, habits, traits, 
Jets ern tviors, and interpersonal reactions of sub- 
Cates treet, the ages of 0-1 and 25 plus. Doll in- 
an over at the purpose of his scale is “To provide 
Of Soci aa measure of personal adequacy in terms 
Scale w maturity” He further indicates that the 
al oo a “descriptive analysis of maturation in so- 
havior Mpetence, as a standardized schedule of be- 
Prescig, (evelopment in terms of its habitual ex- 
standard He feels that it has use in establishing a 
ing evi Schedule of normal development, in measur- 
lems a tations which may be significant in such prob- 
zte, in delinquency, amentia, adoption of children, 
Or the, Measuring improvement following training 
*tapy, etc, 


Scale, 
. Wior 
ay 
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There are 117 items in the scale, arranged in order 
of average age norms. The items have been chosen 
to report some aspect of the individual's ability to 
look after his own practical needs. Social quotients 
(SQ) “generally comparable to Binet MA and IQ 
can be obtained from the sum of the items scores.” 
The items themselves range from such as “ ‘Crows’; 
laughs” (0-1) to “Advances general welfare” (XXV). 
The items at the upper end of the scale (ages 20 up) 
such as “Uses money providently,” “Contributes to 
social welfare,” “Systematizes his own work,” “In- 
spires confidence,” “Promotes civic progress,” “Ad- 
vances the general welfare,” etc. seem extremely hard 
to evaluate. Nor does Doll’s injunction that “The 
informant does not make the scoring judgment. This 
is done by the examiner after obtaining from the in- 
formant as much detail as practicable regarding the 
behvaioristic facts which reveal the manner and the 
extent of the subject’s actual performance on each 
item” (italics his) really circumvent the essential 
problem of observing and rating items that are es- 
sentially difficult to rate. 

The main purpose of this summary is neither to 
describe the Vineland Social Maturity Scale nor to 
present a survey of the published research on it; it 
is rather to discuss some aspects of its implied ra- 
tionale, and some cautions in its application. Cer- 
tainly the careful use of the scale to distinguish 
those subjects who do deviate from the norms of 
“social maturity,” so that further study of those in- ~ 
dividuals can be made, would be a useful and re- 
warding application of this instrument. However— 
and this is the burden of this review—the Vineland 
Social Maturity Scale lends itself easily to other in- 
terpretations. 

Ordinarily, when one uses an intelligence test in 
order to obtain an IQ, the main purpose of such an 
effort is to ascertain what the IQ is, although the 
implicit assumption may be that the higher the IQ, 
the better. This implicit assumption operates in a 
much more subtle and in a more questionable way 
in the case of the Vineland Social Maturity Scale. 
Specifically, the assumption is that social behavior 
(including social motivation) is desirable as it ap- 
proaches social conformity. Further, the implicit as- 
sumption is that optimal behavior lies in adjustment 
to a standardized society and conformity to the 
“normal.” Without becoming embroiled in the in- 
tricacies of the late Robert Lindner’s concepts of 
rebellion and salutary nonconformity, it still re- 
mains that the Vineland Social Maturity Scale de- 
emphasizes the individual’s fealty to his own image, 
his strength to be himself, his positive (that is crea- 
tive or effective) idiosyncracies, his areas of adapta- 
tion which may bring him pleasure, or the applica- 
tion of his resources (within his total personality 
organization) toward creativity or self-actualization. 
The recent work of Jean MacFarlane at Berkeley 
and Lois Murphy at Sarah Lawrence would seem to 
indicate that the conforming person is not neces- 
sarily the best adjusted person. One is reminded of 
a section of D. B. Klein’s book Mental Hygiene en- 
titled, “In Defense of the Shy Child” (who does not 


410 


necessarily become schizophrenic) and one wonders 
if a section should be added in defense of the non- 
conforming child (who need not necessarily become 
maladjusted, psychopathic, or feebleminded), 

The point of all the above statements js that the 
uncritical use of the Vineland Social Maturity Scale 
may imply an unwarranted assumption of the merits 
of conformity and standardization and to permit a 
confusion between aberrant or Pathological noncon- 
“formity (schizophrenia, for example, at one ex- 
treme). To make these assumptions would be to 
gainsay the infinite variety and the rich diversifica- 
tion of talents and gifts of human subjects. 

As a clinical psychologist—and as a father of four 
—I am not sure that I know what the “best” age 
for toilet training, for example, really is, I would 
also ask whether the child has a problem if he isn’t 
toilet trained by “that” age or rather cannot the 
parent create problems by imparting Parental and 
societal anxieties and concerns—his problems—to the 
child. 

The major reference for the Vineland Social Ma- 
turity Scale is Doll’s The Measurement of Social 


ty, Janet E, The Rotter 
(College Form). New 
Poration, 1950, 


Reviewed by 


Louis Long 


The City College of New York 


l lerman, Sho; 
Hildreth, and P, 
effect upon the ISB. As i 


—his fears, desires, wishes, anxieties 

The ISB consists of 40 “stems” 
completed by the subject. The completions are th 
scored by comparing them with responses that hee 
been assigned a scale value varying from 9 to a 
The total score is an index of maladjustment. ` 

The ISB may be used in two very different ways: 
(a) as a gross screening instrument; and (b), as 4 
clinical tool. It seems desirable to evaluate these two 
uses separately. 


that are to be 
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Evaluation of the ISB as a screening instrument. 
Biserial coefficients of 0.50 and 0.62 between score 
and classifications of adjusted and maladjusted as 
dents are presented in the manual to show how € r 
tive the test is when used as a screening ag 
The small number of cases upon which these 
are based should, however, warn clinicians to Pa 
ceed with caution in using the ISB for this Lait 
Each person using the test will do well to study in 
effectiveness of it in his own local situation. TES it 
essence means that the ISB must be validated A 
which will necessarily require setting up, as In 
groups of adjusted and maladjusted ane 
their manual, Rotter and Rafferty describe pa rion 
the method they used to establish their cri ae 
groups. It is easy to sense their o an Bee 
the use of ratings of adjustment or mialadjus io 
as supplied by instructors teaching classes in nced 
tive study and in mental hygiene, or by Rave 
student clinicians, In the reviewer’s opinion, E ass 
culty of establishing satisfactory criterion Eia 
will inevitably make it impractical for many eee 
to use the ISB. If, however, the aggressive kem i 
Program which seems to be underway at Pree ileges 
continued it may eventually be possible for De 
to use the ISB as an aid in screening studen 
Possible referral to a counseling agency. 
Evaluation of ISB as a clinical tool. To 


the use of the ISB as a clinical instrument t 
thors of the 


facilitate 
he au- 
ring 


have given many esin es 
responses, have presente the 
the correct scoring of tion 
Sponses, and have given a clinical interpre jef 
six records. Each of the six cases begins von by ê 
background sketch of the individual, followe nalysis 
record of his responses on the ISB, and an ‘ial al 
of the case in terms of familial attitudes, S° račte" 
sexual attitudes, general attitudes, and € and ê 
traits. The reports conclude with a summary, These 
discussion of the contribution to the I 
cases are presented to illustrate the poen i 
of the ISB and it is emphasized by the miat 
only some of the possible interpretatora aes 
cluded in the analysis. As one reads the penne see”? 
Studies the responses other interpretations 0 of e 
plausible, This in a sense is an indication sg of 
value of the 


B * + at 
a projective situation is to furnish leads 1 tt : 
be explored in an effort to gain clinica the 158 
The authors are effective in showing how be 


ou - 
adds to their understanding of clients. It W p 


valu? 
s that 


a jbution CO 
interesting to know how the ISB’s contributio spe 


Pares with that of the Rorschach or the T. on: of 
cific information about the relative contrib ed- it 
the several projective devices is urgently nee int on 

The authors of the manual are careful to ie tbe 
the limitations of the ISB and to remind reade'S p i 
all data presented relate to the college form: ad 
Somewhat unfortunate that high school om tio 
forms are listed as being available. Until 5U 
as manuals and norms are available it WOU 


$+ 
E og" 
desirable to keep such listings out of test cata 


. osi 
test since one of the main PUP ay — 
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the though there has been much emphasis on 
Sinden nial importance of broader, second- 
other Personality factors, by Thurstone and 
artic. and even some claims to recognizing 

( ular second-order factors by Eysenck 

h as the present writer (2, 4), there 
Baek ot existed until this year any very firm 
titer evidence for conclusions. The present 
h 
a 
e 


0 
i 
ren S Carlier attempt (4) was admittedly 


20) 

a: 

asis 

Wi 

m ta tA, while Eysenck’s extensive argu- 

anq « OY a second-order neuroticism factor 

baseq extraversion” factor (20) seem partly 

loy ie the misapprehension, mentioned be- 

ob ain at second-order factors can be reliably 
e ENN factoring correlations among 
timar Scores on the existing measures for 
t factors. There are, indeed, threë 
cond 
C 

ti 


le 


f 

f 
t d 
p 
Y 
with p widespread misapprehensions, dealt 
Secon elow, which may confuse research on 


s 
e 
e 
d t: 
Vv 
t 
t. 
a 
h 
0: 
A _ order factors, 
Obli 1a ond-order factor is a factor among 
btaing Primary factors. That is to say, it is 
tion by factoring a matrix of correla- 
torg g pure measures of primary fac- 
ond a Totating to simple structure. The 
A rad factors will be less numerous 
teng a orders, or “primaries,” and will 
Ample Cover wider areas of behavior. For ex- 
the qg the general ability factor, on which 


\ vidua) 18 based, covers more than the indi- 


ei 
y 
ed 
Se nh 
tha 


s 
n 
t 
a 
m, 
ř 
h 
q 
s 
nd 
l 


i i 
h Which Primary abilities of Thurstone, from 
; (30) t is derived as a second-order factor 
Th 
nd, o g'heoretica] and practical value of sec- 


tor Order factor. lağ a aan 
Tre is an joo, relative to first-order 

the qp. Ssue with partisans on both sides. 

‘ Seq Sec, €Oretical realm some, like Hsii (25) 

Nore Ond-order factors as “super factors,” 

“manent and more deeply rooted in 


physiological or sociological fact than first- 
orders. Others (6, 24, 33) consider the pri- 
maries as the psychologically-real concepts 
and second-orders only as more transient or- 
ganizing principles among them. The former 
is illustrated by the theory that g is a func- 
tion of the total effective number of cortical 
neurones, but that the primary abilities 
merely represent particular training invest- 
ments of this general relation-perceiving ca- 
pacity, developed in particular sensory or 
symbolic areas. The latter, i.e., the alterna- 
tive interpretation, is illustrated by the pres- 
ent writer’s earlier explanation that the ob- 
served organization of certain personality 
factors (2) represents only the population 
correlation produced among them by selec- 
tion according to the social status conditions 
of the particular country concerned., (See also 
Fisher, 21.) 

Regardless of theory, the practical psychom- 
etrist can predict test performance either 
from first- or second-order factors. But here, 
too, there are preferences, as shown, for ex- 
ample, by the British predilection for work- 
ing with Spearman’s g—the second-order fac- 
tor in abilities (33)—and the American 
preference for primary abilities. If we rule 
out specifics as too numerous to be useful, 
prediction from primaries accounts for the 
greatest possible actual test variance, but 
from second-order factors there is a wider 
field of prediction, in terms of one factor (6, 


30). 
Second-Order Factoring 
For the psychologist, as contrasted with the 
statistician, the importance of factors lies be- 
yond immediate prediction. It concerns isola- 
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gi and the devel- 
tion of pa ee ted a 
ee ke the understanding of behavior 
‘rcs the immediate, static, measurement 
situation. Here, both the first- and the ar 
d-order structure are parts of the tota 
= snowledge, as will be exemplified 
necessary knowledge, akd 
in the present study. However, as indicate 
in the introductory remarks, the second-order 
factors must for this purpose meet certain 
conditions not sufficiently recognized in some 
current studies. g 
In the first place, it does not suffice to take 
any existing test or battery measuring the 
factors, to intercorrelate the factor scores, 
and analyze. Today, and for many years to 
come, the individual factor measures will be 
substantially impure. Each will contain, in 
addition to the inevitable specific, some con- 
tamination with other factors present in the 
battery. The primary measures may, also, in- 
clude in common some factors, e.g., response 
sets, which have nothing to do with the 
intended primary measures per se. Conse- 
quently the factoring of these actual primary 
factor test scores, presuming that each is split 
in two, or increased in number in some way 
to give a sufficiency of variables for deter- 
mining the number of common factors in- 
volved, will yield the primaries again, to- 
gether, perhaps, with the spurious common 
g them due to dimensions ex- 
the primary dimensions them- 


selves, &g., to the response format of the 


battery. 


This theoretical expectation has actu 
been verified in Thurstone’s (31) and Lovell’s 
(27) work on Guilford’s factors (24), where, 
if the battery for each factor is split, and 
each factor reliability is put in the matrix, 
the analysis is shown to yield the Primaries 
again with tolerable precision. This result will 
be readily appreciated by anyone who has 
seen the complete discrepancies between the 
correlation between the raw Scores of any 
two factor measures and the correlation found 
from measuring the cosine of the angle be- 
tween the factors on their simple-structure 

plot. The former, dependent on a cluster of 
items, is pulled all over the Place by the ad- 
dition of fresh items, with their particular 
contaminations; but the latter remains firm. 


ally 
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: n 
For the hyperplane is fixed b}. yari s a 
many dimensions that are not loaded a be 
factor in question. However, it ey sone 
granted that where factors are alrea' la es 
purely measured by existing tests, pres- 
systematic bias and with effective : “ ‘he 
sion of peer factors in each factor sc a SE 
factoring of actual factor scores, i.e., éason: 
variable for each factor, may yield a actors: 
able approximation to second-order the 16 
This seems to have happened with (8): 
P.F. test in the large Air Force se n a 

However, the matrix with which a cosine 
order factoring properly begins is t srimary 
matrix among the simple-structure i struc 
factors. Few oblique rotations to ong deter- 
ture undertaken in the usual course ° guratë 
mining the form of the primaries ae “Indeed: 
enough for a second-order TaEREME r show, 
as French’s (22) and other an analy- 
perhaps a half of all published fac al—ev 
ses falter and fall short of their S actors“ 
the goal of defining the first-order Je struc 
for lack of thorough search for simp 


“ solish- 
ture. Even the last couple of org ten to 
ing” rotations, in the usual sas origin? 
twenty over-all rotations from 


m 
alter the nu! 


position, will substantially hat wou 


and nature of second-order factors t i 
be obtained. „inst a 

One needs also to be warned a nas 
sent-mindedly factoring—as the vanes ae 
done before (4)—the matrix of pee mons 
achieved, for these are the correlati ç must p3 
the reference vectors. Such a matti fac 
inverted to give correlations am T notation yi 
tors. Thus when, as in the usual ! i 
is the obtained transformation eer 
ceeding from the extracted factor 
to the best simple structure me a 
required square matrix for secon 
toring is 

D(X) >D af 


ose 5 
where D is a diagonal matrix the De solaan 
which is to normalize by rows AA her 
the obtained inverse (6). In eon -of 98 
three pitfalls to be avoided in Pe ati? 
factoring are: taking primary © le sts 
from raw scores instead of the si relation 
ture plot; using reference vector 5 de 
instead of factor correlations; and, 


= 
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with below, leaving second-order factors or- 
thogonal instead of seeking simple structure 
for them also. 


The Questionnaire Foundation 


_ The number of primary personality factors 
M questionnaire responses is still not fully 
determined, but the recent studies of Guil- 
ford (24) and of the present writer (10, 11, 

Converge in indicating that (among 
adults) about fifteen will account for most 
o the variance in highly varied collections 
PRE In the case of the author’s studies 
> tige of his research associates, the close 
Hai, mation maintained between question- 
oe and observer behavior-rating factors 
ftes, additional confirmation, in that some 

n factors have also been found in the 
atter (3, 12), 
The fifteen 


primary personality factors on 
He the present study is based have since 
alit been embodied in the Sixteen Person- 
“i Factor Questionnaire (15), into which, 
een otal utility, general intelligence has 
truc built as the sixteenth factor. The factor 
telli ture of the 432 items (466 less 34 in- 

Igence items) comprising the A, B, and C 
St as Of this test has been verified in three 
toati each experimentally, statistically, and 
bread ee independent (5, 10, 11). A wide 
ites th of behavior reference in the 16 P.F. 
tvey oS been guaranteed by the historical 
the 7 (3) and by the concept of sampling 
Sis (sronality sphere made in the first analy- 
furth ), as well as by examination of 2,002 
(t0, iy in the two succeeding studies 


Ma YPotheses as to what the fifteen factors 
been © which so persistently appear have 
Hoy Put forward (3, 15, 22) and debated. 
OF ant it is only recently, with the return 
Test ernal validation results from the 16 PF- 
aq Aes 14, 15, 34), in clinical, educational, 
bee dustria] use, that these concepts have 
the ‘valuated and sharpened. For example, 
of mination of the degree of inheritance 
forms ie factors made on their equivalent 
With J" the Junior Personality Quiz (13) 
Dart Cleven-year-old twins, siblings reared 
the} Ste. (14), has thrown much light on 
Pears asic natures. From these studies, it ap- 

that 2 of the 15 factors (A and H) 
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are hereditary components of the cyclothyme- 
schizothyme temperament continuum; that 
others, e.g., surgency-desurgency (F), and 
sensitivity (Z), are almost wholly environ- 
mentally determined; that the factors C and 
G correspond to the clinical concepts of ego 
strength and superego strength; that E, L, 
and Q, correspond to the concepts of domi- 
nance, paranoid trend, and radicalism, and 
that O and Q; characterize two relatively dis- 
tinct components in anxiety. More precise 
discussion can be given to these meanings of 
primaries where it becomes relevant to the 
interpretation of the second-order factors 
among them found here. 


Correlations Among Primaries 


Determination of the cosines (correlations) 
among the fifteen primary factors was based 
on the third (10) of the above studies on 
the 16 P.F., which had benefited from the 
preceding studies in acquiring more highly 
loaded items, and, therefore, a clearer factor 
structure. The correlation matrix was of or- 
der 75 X 75 and consisted of 2,775 product- 
moment correlations on an W of 408 subjects 
(181 undergraduate men and women stu- 
dents and 227 Air Force young men in train- 
ing). Although the 16 P.F. test was repre- 
sented by only 75 variables it will be seen by 
reference to the studies indicated (10, 11) 
that these truly represent the factor structure 
of the whole test. The special procedure of 
parcelled factor analysis, by which the 163 
highest loaded items in the test are parcelled 
into 75 short scales of two and three items 
each (because of the impossibility of handling 
a 163 X 163 matrix) has been described else- 
where (11). It gives the test as a whole the 
structure of the 75 parcels, and evaluates each 
item in the total 16 P.F. against the factors 
established in this framework. 

For purposes of determining the angles 
among oblique factors with great exactitude, 
in order to enter a second-order factor analy- 
sis, this design of having each factor loaded 
on only 5 out of 75 variables is particularly 
valuable. For the even distribution (each fac- 
tor represented by the same number of vari- 
ables) and the great preponderance of vari- 
ables in every hyperplane (70 out of 75 is 
possible, and was closely approached in our 
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Table 1 
Cosines Among Reference Vectors 
Primary Personality Vectors 
Q:) (Q) 
wW © © (© © ® © @ M) (N) (©) (Q) (Q) ( 
1.01 
a 413 1.00 
(E) 07 06 1.00 
(©) =01 .05 00 99 
(G) 00 04 —.02 05 100 
Œ) -.36 —.12 —.18 —.26 00 100 
(D —29 —04 —.06 01 00 14 1.01 
(L) —01 -01 -06 —.14 —.04 26 —.04 1.00 
(M) 03 14 06 6 M 05 —14 —07 99 
W 08 Ol =i 9243 05 26 —.05 —.02 101 
(0) 02 19 00 -04 02 3 yy —08 -06 04 1.00 i 
Oy S15 05 =81, ~P Al -09 02 o1 —.19 00 01 | 01 
(Q:) 07 —01 18 22 02 (93 =l -01 —.11 03 ‘og —1 2 1.00 
(Q) 30-19 2 222 19 _ 59 =02 11 -04 ~22 20 100 ‘on as M 
(Q) 04 o9 o2 o5 — o5 o AS —15 =o —07 =17 03 | 


study) permits a very sure perception of hy- 
perplanes and their angles, Actually the mean 
percentage of variables obtained in the aver- 
age hyperplane (between + -10 loadings), for 


to 91 per cent, which is 
other published or unpub- 


this study to define, i.e, 
im, any given factor, 


roxi- 
The simple structure was actually “Piying 
mated with relatively little labor BY ae E 
Wrigley’s quartimax method (28). 1 method, 
the nearest approach by an analytica ] struc 
and within a Procrustean örthogons How- 
ture, to the eventual oblique SE short 
ever, since this analytic method A to 
of the best simple structure, by F oid and 
leave too much variance in the ceal obliga 
through failing to follow the T Graph; 
ties, rotation was finished “by han tner (105 
cal plots of each factor with ag fa four 1% 
plots per rotation) were made. A rtimax P° 
tations of all factors from the qua 


Table 2 


Correlations Among Factors 


timary Personality Factors ( Qu 
Qs) 
(4) (©) ® ®© (© u) D © M Mm © @ @ í 

(A) 

(C) —.19 

(E) —.02 —.04 

(F) 16 —.04 16 

(G) —.04 04 —.05 —02 

(H) 15 32 2 28 o 

( 30 —.15 -.06 ~12 02 —.24 

a) 04 —.26 00 03 —02 —42 45 

(M) —.06 —.20 —.08 —36 o5 =28 233 15 

(N) =—22 17 16 15 —08 - 26 =40 —.11 —13 

(0) 13 —.44 —.02 03 —07. F 38 Ay: e 

(Q) —.16 —.03 .31 —.03 —.ir* “og =05 =02 48 08 —03 

(Q) —.06 —.06 —.20 —33 —01 —24 49 083 28 7? o t it 

(Q) —.32 47 ~03 —.14 18 “4p T24 —.39 —08 733 —52 04 T -2 

(Q) 03 —.31 -0 02 —02 —28 i -33 09 —05 38 — 04 | 
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en a very clear structure was obtained. 
ty fifth “polishing” rotation was carried out 
a, EE the best possible determination of 
ET e mean hyperplane content indi- 
aid 4 r ove, 91 per cent, was thus obtained, 
er significances of the simple structure 
1) mations, tested by Bargman’s formula 
a a was found to be beyond p= .001 for 
ch of the fifteen factors. 
Ts Cosine matrix, C = NÀ, among the ref- 
able vectors at i this „point is given in 
a l and its inversion and normaliza- 
ai to the correlations among the factors, 
hed SD, in Table 2. It will be observed 
tin, . usual the intercorrelations among the 
are higher than among the vectors. 


ti 
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t Simple structure in the second-order realm: 
Fı plotted against F2. 


The Second Order Factors 
Cn, the factor extraction from Table 2, 
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Table 3 


Rotated Second-Order Factor Matrix 


Primary 

factors F: F: F: Fe 
A +.07 +45 +.56 —.10 
c —.53 +.10 —.25 —.10 
E Tee —.01 +04 4.50 
E +17 +48 +.04 +.21 
G —.09 —.01 —.08 —.23 
H —46 +.33 —.03 “4.23 
I +.03 +.01 +.53 —.20 
È +.54 —.13 —.05 —.09 
M +.07 —.51 +.13 +.04 
N —.08 —.09 —.48 +.34 
o +.62 —.07 4.16 — 05 
Q —.12 —.42 +.05 +.55 
Q: —.06 —.38 +.17 —.08 
Qs —.66 —.01 —.29 — 02 
Q +.62 —.09 —.09 +.00 


Note.—The unrotated matrix (the quartimaxed matrix, Voq, 
from which the transformation matrix operates) and the trans- 
formation matrix by which this table was obtained have been 
deposited with the American Documentation Institute. Order 
Document No, 4969 from ADI Auxiliary Publications Project, 
Photoduplication Service, Library of Congress, Washington 25, 
D. C., remitting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photoduplication 


Service, Library of Congress. 


second-order factors. Simple structure may 
here be harder to determine without am- 
biguity, because of the fewer variables, but 
enough second-order studies now exist (12, 
25, 30, 33) to show that simple structure 
commonly resides in the data and gives psy- 
chological meaning to factors thus uniquely 
determined. Accordingly, the second-order 
factors were rotated, and, after seven rota- 
tions, the structure shown in Table 3 was 
found. From the typical graph in Fig. 1 it 
will be evident that this is a very clear struc- 
ture and practically unimprovable. (Possibly 
a 5° shift could still be made on each factor.) 
The number of variables in the hyperplane— 


ri $ 
Citerior a by the centroid method, m Tale & 
i 6) indi five factors. 
j a ere a i Cesare rotation Correlations of Second-Order Factors 
So, l collapsed gn ce po One of the (Simple structure after seven rotations) 
t : 
olt S of confusion in second-order factor = 
ete” mentioned above, is that experi- -emmm 
Ple z Who rotate primaries for-obliqne sim- i Resear] 5 7 A 
Org, UCture nevertheless somexinies? ide gattt 
` fop 28 onal, past A ats [OnNPING j 
| O segn g? Unrotated, centroid interpretat i 
Son, ond-order factors. The well-known rea.. i in 
(6, 30) Oblique simple structure in primaries pe A atk 
actually apply just as forcibly to ` 
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slightly more than half—is about that found 
in most’ satisfactory first-order structures. 

The intercorrelations of second-order fac- 
tors (D(\’A)7D), derived from the trans- 
formation (Lambda) matrix are shown in 
Table 4. 

The chief indicators of the nature of Fac- 
tors 1 through 4 in Table 4 will now be set 
out verbally, a contingent title being given to 
each factor. 


Factor 1. Anxiety-vs.-Dynamic 
Symbol 


Integration Loading 
Q:3(—) Lack of will control! 66 
O(+) Insecurity or free-floating anxiety 62 
Q;(+) Nervous tensions (somatic anxiety) .62 
L(+) Paranoid trend 4 
C(-) Lack of ego strength 253 


This factor has clearly brought together 
the “pathological” primaries, Before turning 
to interpretation one may point out that the 
evidence on second-order 
havior-rated personality p 
published synchronous] 
ticle, shows a factor 
except that Factor I, 
is included there. Thr 


» a factor of 


li general 
neuroticism; and third, th: 


Nevertheless, considerin 
ture of the above prim 
might incline to an int 
ond-order factor as D 


1 The titles used are those of the 16 P, 
book (15). To make easy, consistent reading, all 
loadings have been made positive, by reflection, in 
these factor lists. The reflection is indicated by the 
sign on the left and the change of title to the op- 
posite pole, eg., “Lack of... .” 


F. Hand- 
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interpretation Eysenck’s interpretation of Ul Y 
23 as the neuroticism factor (20), an oe 
tion qualified somewhat by our reinterpreta 
tion of U.I. 23 as reduced neural zeera 
rather than neurotic conflict per se. On t i 
other hand, U.I. 24, with which the pen 
second-order factor apparently identifies A 
self, is better described as anxiety than 3 
conflict. Accordingly, since reliable aesa 
tion is more important than interpretation seg 
this stage, it would seem best to canoe 
by naming the present second-order an 
naire factor Dynamic Integration-vs.-An®! 


Factor 2. Extraversion-vs.- 


ing 
0 Loading 
Introversion 


Symbol 


M(—) Practical concern or praxernia (12) 51 
(vs. Bohemianism or alaxia c12) 48 
F(+) Surgency 45 
A(+) Cyclothymia 42 
Q(—) Conservatism 38 
Qx(-) Lack of self-sufficiency s 
H(+) Adventurous cyclothy mia or parma 33 


(12) 


‘of 
1 behav} 

3), it may 
that = 2 


this ! 


Since the parallel study in rate 
factors is only now appearing (12), 
be stated for the reader’s information 
second-order factor (F4) resembling MIF 
found therein, combining high F and ire 


l F nnal 
with high D (not entering into ames ma i 
experiments). There, Æ factor, don hat 4 


also enters in, and it is noteworthy r Fae 
alternative rotation considered here ould 
tor 2 on 4, reducing their conten nä 
also bring it in here. A second con 2 amo”? 
of the pattern is found in that U.I. o “(0% 
objective tests correlates significantly | ih 
01) with Factors F, A, Qo, H and E; ese 2° 
M and Q, are not as significant. t indio” 
thus, once more, quite independen i 
tions of the same pattern. two pe 

This pattern has pulled together reco! 
mary factors which have been long parat” 
nized as cyclothyme-schizothyme t wr | 
ter, but it emphatically adds aiher ¢ oF 
might go under the broader cote ainat 
traversion—such as surgency, dor cien, 
practical concern and lack of er a 
Along with conservatism these Pep jite 
person closely identified with the gt? depe | 
“a good fellow”—as opposed to the m of n 
ent recluse. The relatively low ings A fa 
more hereditarily determined H a” 
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tors (14) suggest that Factor 2 is an envi- 
Tonmentally determined pattern. There now 
Seems ground for recognizing extraversion-in- 
traversion as something more than a correla- 
tion cluster or surface trait, and perhaps for 
Specializing the term for this measurable 
Second-order factor. 


Sy Factor 3. Cyclothyme-vs.- g 
Imbol Schizothyme Constitution Loading 

w Cyclothymia 56 

+) Emotional sensitivity or premsia 
(12) 53 
aa Lack of sophistication AS 
Coy Lack of will control 29 
) Lack of ego strength -25 

A 


in o a somewhat similar factor is found 
rae Second-order among behavior-rated fac- 
With a No. 5 (12), which links cyclothymia 
build OW ego strength. A constitutional, body- 
beri hypothesis was there suggested for ex- 
ate ment, Although only preliminary results 
(hi *vailable it seems also to be the pattern 
ee 4, I, low N) distinguishing manic- 
reso sives from normals (15), and has fair 
fro mblance to that distinguishing women 
Ran Men (15) (but women have higher 
ta ‘c-depression and lower schizophrenia 
is well known). A constitutional 
factor connected with cyclothymia 
YPothesized. 


body. 
i Y-build 


Symp Factor 4. Unbroken Success-vs.- p 

Q, ie Frustration Loading 

BY Radicalism ey 

M4) Dominance oF 

Cj Sophistication 33 
A Low super ego strength pene 


factor in it is noteworthy that a second-order 
havig (Factor 2) among observer-rated be- 
ing * factors (12) presents a pattern agree- 
Mon Xcellently with this in the variables com- 
Dreses, the two studies (Æ, N, and G). The 
hayi nt study adds Qı and the objective be- 
dy pot Study adds high intelligence. Possible 
Sloneq CSES ate “easy personal success” occa- 
«al by good intelligence or good ee 
is pp, PPOrtunity, or “social status,” whic 
aq aial to be correlated with intelligence 
telateg Vance (2), and could well be cor- 
Youn, Vith sophistication and radicalism, in 
Mindeg mer: Incidentally, the reader is re- 
a faq, Of the evidence that “radicalism,” as 


c 1 k: 
tor, is more than an accident of politi- 
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cal belief, and constitutes a general tempera- 
mental source trait (19, 29). e 
Doubtless a generous native endowment in 
abilities plays a large causative role in this 
syndrome. One is reminded of a famous am- 
bassador’s comment on a British Secretary 
of State, known for his radical innovations, 
dominance of the world scene, sophistication, 
and debauchery (low G/): “his capacity is 
on so high a level that he has no need to 
give up his pleasures in the slightest degree 
for any cause” (17, p. 478). But in the life- 
record factor (12) the intelligence loading is 
scarcely high enough to make it the essential 
root, and the loadings are similar to those for 
social status. Consequently it is safer to con- 
sider this as the organization within person- 
ality brought about by unbroken success, 
from whatever cause, as opposed to frustra- 
tion and intellectual bafflement. Among stu- 
dents it should correlate negatively with age. 


Summary 


1. A questionnaire—the 16 P.F.—broadly 
based on the personality sphere and over 
2,000 items, had its factor structure redeter- 
mined on a sample of 408 young men and 
women, with particular attention to exact ro- 
tation to the best simple structure. 

2. The correlations thus determined, i.e., 
by inversion of the reference vector matrix, 
among the 15 confirmed primaries (intelli- 
gence was omitted) factored to four second- 
order, simple-structure factors. 

3. These four factors have resemblances, 
ranging from fair to excellent, to four second- 
order factors found from life-record (behav- 
ior rating) primaries, and two of them have 
closely similar profiles to the correlations 
found between questionnaire primaries and 
two objective personality test factors. The 
latter seems to confirm the surmise, made on 
general principles, that objective test factors 
would tend to be on a different level from 
rating and questionnaire factors, and, gener- 
ally, to be second-order to them. 

4. The factors have been contingently 
named Dynamic Integration-vs.-Anxiety (Ob- 
jective test factor: U.I. 24); Extraversion- 
vs.-Introversion, (Objective test factor: U.I. 
32); Cyclothyme-vs.-Schizothyme Constitu- 
tion; and Unbroken Success-vs.-Frustration. 
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i ignificant positive correlation here 
a peter and fourth, as also was arra 
in behavior rating second-order factors ( ). 
Definite hypotheses are Proposed for sn 
further experimental investigation. As a pari 
of such investigation it is desirable to score 
individuals on the 16 P.F. not only for pi 
maries but also for these four second-or: F 
factors (from the above loadings) to see i 
higher correlations with a specific criterion are 
associated with second-order than with first- 
order factors. Dynamic Integration scores 
should be of particular interest to the cli- 
nician. 
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Factors, Response Bias, and the MMPI 


Eugene H. Barnes 


VA Hospital, Downey, Illinois 


Certain deductions concerning the influence 
response set on the MMPI were tested in 
poecent article by Barnes (1). These deduc- 
lons were derived from Berg’s deviation hy- 
Pothesis (2) and other pertinent research. 
his hypothesis asserts: “Deviant response 
pies tend to be general; hence those devi- 
3 behavior patterns which are significant 
p abnormality and thus regarded as symp- 
S a are associated with other deviant re- 
Se patterns which are in noncritical areas 


of 


o 4 
z havior and which are not regarded as 
62) toms of personality aberration” (2, p. 


fon the scoring system of the individual 
ite of the MMPI provides that only those 
S answered in the infrequent direction are 
dota the MMPI provided a convenient 
Bers 7°! deviant responses as defined by 
8. In his article Barnes (1) presented cor- 


teco: 


relati 
Pa tions of the MMPI scales with the num- 
wit of items answered atypically true and 


He fo e number answered atypically false. 
ing -2d the tendency to deviate by answer- 
the false to be more highly correlated with 
ang 2l6s of the neurotic triad (Hs, D, Hy) 
the tendency to deviate by answering 
to be more highly correlated with the 
of the psychotic triad (Pa, Pt, Sc). 
t, the two tendencies were not signifi- 
Correlated with one another. 
bins tt analysis of the MMPI scales 
Patient the scores of 110 neuropsychiatric 
ehnat Was reported by Wheeler, Little, and 
One er (6) in which two major factors and 
the «ior factor were identified. Factor I, 
in pY chotic” factor, had its maximal load- 
stanti, $ and Sc. This factor also had a sub- 
“hey a" negative loading on K. Factor II, the 
on yi” factor, had its maximal loadings 
© Scales of the neurotic triad. 


Scales 
Purthe 
cantly 


The correlations reported by Barnes (1) 
are sufficiently similar to the factor load- 
ings on the two major factors reported by 
Wheeler, Little, and Lehner (6) to suggest 
that the sets may be empirical correlates of 
the rationally derived factors. Specifically, it 
is hypothesized that, if included in the cor- 
relation matrix, the vector representing num- 
ber of true answers would be approximately 
collinear with Factor I, while the number of 
atypical false answers would be approximately 
collinear with Factor II. 


Procedure 


A direct test of this hypothesis does not 
appear possible since different samples are in- 
volved. An indirect method is to assume the 
existence of a test whose vector is collinear 
with the reference vector, calculate the cor- 
relations of each test in the matrix with the 
hypothetical test, and compare these calcu- 
lated estimates with the obtained correlations 
of the test under investigation. In order to 
make these calculations it is necessary only 
to know the communalities of the tests in the 
original matrix, the cosine of the angle each 
makes with the reference vector, and the com- 
munality of the hypothetical test (5). Re- 
fined estimates of the communalities of the 
tests in the matrix are provided by the factor 
analysis. The cosine of the angle each test 
makes with the reference vector is simply its 
factor loading divided by the square root of 
the communality. The communality of the 
hypothetical test must be estimated. In this 
predicament it seems logical to use the same 
approximation recommended for such esti- 
mates in the original factor problem, i.e., the 
highest correlation obtained between the sus- 
pected collinear test and any of the other 
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Table 1 


Correlations of Atypical Responses and Hypothetical 
Tests with Scales of MMPI 


Eugene H. 


Barnes 


Table 2 
Communalities and Reliabilities of MMPI Scales 


Communalities Reliabilities 


Hypo- Hypo- 
Atypically  thetical Atypically thelial Wheeler, HCE be 
Scale false Test II true Test I Little, & Rosen ais 
= Scale Lehner (6) (4) ( 
A 37 — —.24 = 
F «43 — 66 64 L 234 02 cd 
K 06 — —.69 —67 PF .700 81 “ 
Hs 56 63 32 50 K 643 -65 i 
D 73 55 34 46 Hs 873 B5 67 
Hy 59 72 — 09 = P TH ‘80 30 
Pa 28 = 68 6 Hy 71 ‘88 “ 
Mf 21 — 28 36 Pd ‘531 88 EA 
Pa 37 = 52 -60 Mf 338 64 ay 
Pt 31 — 84 89 Pa 780 75 he 
Se 36 = 90 88 py O44 80 w 
Ma 21 = 50 59 Se ‘878 83 4 
Ma 494 .56 a 


Pproximation jt 
pute the scalar 
» Which turns out 


Results 


The correlations ex] 

I e pected for the hypo- 
thetical collinear tests as compared with ih, 
correlations obtained by (1) are : 
sented in Table d that a 

i- 


and Lehner (6). It is presumed that these 
omitted factor loadings were not considered 
significant. This would be consistent with th 
low predicted correlations, i 

It is obvious that the predicted correlations 
for a hypothetical test collinear with Factor I 
are in very close agreement with 
mental results of correlating the 
atypically true answers with the Scales of 
the MMPI. The agreement of the Predicted 
and obtained correlations for the number of 


the experi- 
number of 


r 
atypically false answers is not so close, ae 
yet does it seem so divergent as to N 
hypothesis. Unfortunately there does aol 3 ap- 
to be any significance test which can oe 
plied to the kind of data presented. The there’ 
ing of the results cannot be evaluated; 7 e. 
fore, with the precision which is desira 


Discussion of 
ber 


The correlations between the num scales 
items atypically answered true and T a 
of the MMPI are cogently similar tot 1 test 
relations predicted for the hypothet ay i 
despite the lack of the significance test- jn ac 
would appear to be little risk involve o 
cepting this measure as a “pure ee pre 
of the “psychotic factor.” Although t type 
dicted correlations for the number of tri 
cal false answers do not have such @ Pin 
similarity, it is clear that, if included heavy 
test matrix, this measure would have & js 700" 
loading on the “neurotic factor.” For t pould: 
son scores based on these response = we Rs 
in themselves, be of considerable inte? sur 
should be remarked, however, that 4 at pied 
of the “psychotic factor” cannot be ari 
as a measure of psychotic tendencies ote at 
further experimental evidence. A simi upet 
more emphatic caution applies to the ily w 
rotic factor,” and the tendency atypic? ‘ 
answer false, 


sae rei 
Tn addition to their interest as meas" 
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Factors, Response Bias, and the MMPI 


Would seem that they might have another 
value. A comparison of the communalities re- 
Ported by Wheeler, Little, and Lehner (6) 
With reliability coefficients reported by Rosen 
(4) and by Holzberg and Alessi (3) suggests 


that a degree of specificity remains in some 
Ot the scales. This comparison appears in 


able 2. Since these two factors accounted 
for most of the communality of the scales of 
the MMPI and, since the two response sets 
“Pear to be relatively pure measures of the 
factors, it would appear that some adjust- 
ment of the scoring should be possible to 
reveal the remaining specificity. Such an 
adjustment should considerably increase the 
Agnostic precision of the MMPI. It is not 
“ear to the writer exactly how this adjust- 
ent could be accomplished, but it seems in- 
ser pable that some allowance for response 
tt will be necessary in the interpretation of 

the MMPI, 
n is Possible that the method of analysis 
a in this study may recommend itself to 
nE Investigators. The technique may be of 
Wea to the test constructor seeking to de- 
OP “factor pure” tests as a check of sorts 
em 'S success. Further, it might be used as 
in ethod of selecting measures to be included 
a matrix for factor analysis. It would seem 
varticularly appropriate if a previous analy- 
as given suggestive but somewhat equivo- 

“al results, 


Summary 
a Two Major factors, a “neurotic” factor and 
Wh Psychotic” factor, were identifed by 
celer, Little, and Lehner (6) in a factor 
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analysis of the scales of the MMPI. Hypo- 
thetical tests collinear with these factors were 
postulated and the correlations of these hypo- 
thetical tests were computed for each of the 
scales in the correlation matrix for which fac- 
tor loadings were reported. These correla- 
tions were compared with those obtained by 
correlating the number of atypical true an- 
swers to the MMPI with the scales of the 
MMPI and those obtained by correlating the 
number of atypical false answers with the 
scales of the MMPI. It was concluded that 
the number of atypical true answers is a 
“pure factor test” of the “psychotic factor” 
and that the number of atypical false answers 
has a heavy loading on the “neurotic factor.” 
It was also concluded that some allowance 
should be made in the interpretation of the 
MMPI to allow for the influence of response 
set. 


Received February 6, 1956. 


References 


1. Barnes, E. H. Response bias and the MMPI. J. 
consult. Psychol., 1956, 20, 371-374. 

2. Berg, I. A. Response bias and personality: The 
deviation hypothesis. J. Psychol., 1955, 40, 

61-72. 

3. Holzberg, J. D., & Alessi, S. Reliability of the 
shortened MMPI. J consult. Psychol., 1949, 
13, 288-292. 

4. Rosen, A. Test-retest stability of MMPI scales 
for a psychiatric population. J. consult. Psy- 
chol., 1953, 17, 217-221. 

. Thurstone, L. L. Multiple-factor analysis. Chi- 
cago: Univer. of Chicago Press, 1947, 

6. Wheeler, W. M., Little, K. B., & Lehner, G. F. J. 
The internal structure of the MMPI. J. con- 
sult. Psychol., 1951, 15, 134-141. 


uw 


al oj Consulting Psychology 
ears, No. 6, 1956 


The Personality of Judges and Their Agreement with 
Experts in Judging Clinical Case Histories 


A. W. Bendig' 


University of Pittsburgh 


Large individual differences among judges 
in assessing Clinical case histories suggest that 


ty, educa- 
lity traits 
ch factors 
rmal char- 
ation: the 
the method 


ability. 
= 96) ranked 


completed the 15 
Preference Schedule (1). The 


groups and the high and 
low agreement Ss of Group I W= 56) com- 


1An extended report of this study may be ob- 
tained without charge from A. W. Bendig, Dept. of 
Psychology, University of Pittsburgh i 


iliary Publications Project, Photoduplication Service 
Library of Congress, Washington 25, D. 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress, 


> 
C., remit- 


S 
pared on each of the 15 scales of the aa 
by two criterion (case type and e i 
group) analysis-of-variance pines ie 
of the PPS scales, Achievement and ) dis- 
tion, significantly (.01 level or Oe aah 
criminated between the high and vg case 
ment groups, while the interaction nificant 
type and agreement group was Bn high 
(.05 level) with the Order scale. T th the 
agreement group was higher on ere the 
Achievement and Exhibition scales, in cases 
high agreement Ss ranking the aoe child 
and the low agreement Ss ranking simi- 
Cases scored higher on the Order sca a on 
lar analyses of variance were ee il 
these three scales for the replication F ratio 
(W = 40) and none of the eget agree 
approached significance. Again the hig on the 
ment Ss showed high mean scores put the 
Achievement and Exhibition scales, 
differences were not significant. js that 

The obvious conclusion of this a e 
there are no consistent relationships of Bt 
the scores of naive Ss on the scales expert 
wards’ PPS and their agreement ag owevel? 
in judging clinical case histories. t other 
this does not exclude the possibility o corte” 
personality measures might show som 
lation with judgmental ability. 


Brief Report. 
Received July 6, 1956. 
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Comparison of Two Methods of Electroshock in 
Their Effect on Cognitive Functions’ 


Barbara S. Kendall, Warren B. Mills, 


Washington University School of Medicine 


and Thomas Thale 


St. Louis University School of Medicine 


Electroconyulsive therapy (ECT) commonly 
Produces temporary confusion and disturb- 
Se of attention and of memory in the 
a ated patient (6), or, as Stone (10) points 
au a general impairment of cognitive func- 
ag These unfortunate effects may accumu- 
“ during the treatment period, but tend to 
imp ear within two or three weeks after the 
val shock. It has usually been assumed that 
ess by the Reiter apparatus, because a 

er amount of current is necessary to pro- 
See Seizure, results in less disturbance to 
cu functions than does the conven- 
btn Method (1, 2, 12, 13). Yet there have 
mea no well-controlled studies dealing with 
abit ured differences in the effect on “test 
ity” of these two methods. 
foll € aim of the present study is to test the 
wing hypotheses: 
the ie the same therapeutic result ECT by 
impai €iter method causes a lesser amount of 
Nene t of cognitive functions, demon- 
oes e at the end of the shock series, than 

2 ECT by the conventional method. 

Shoy Patients shocked by the Reiter method 
Wee less residual cognitive disturbance two 
ti S after the final convulsion than do pa- 
treated by the conventional method. 

Wo weeks after the last convulsion, 
gains in cognitive tasks over preshock 


C 


Score 


1 
De at authors acknowledge their indebtedness to 
tisti dine C. Gleser for help in planning the sta- 
Tohns treatment of the data and to Dr. Laverne C. 
ing val for reading the manuscript and for mak- 
the p able suggestions, This research was done at 
âlcolm A. Bliss Psychopathic Hospital. 


performance are greater and losses are less 
for patients treated by the Reiter method 
than for those treated by the conventional 
method. 


Method 


Amount and type of treatment. Two groups 
of patients treated at the Malcolm A. Bliss 
Hospital are compared with reference to cog- 
nitive changes induced by ECT; one group, 
in which all were treated with the Reiter type 
46 E machine (which delivers pulsating “uni- 
directional” current), will be referred to as 
the “Reiter group”; the “Conventional group” 
consists of those receiving treatment with the 
Lektra machine model 302 (which puts out 
a single burst of unmodulated 60-cycle sine 
wave alternating current). In order to insure 
uniformity, all patients were treated with a 
bitemporal placement of the electrodes, and no 
patient was presedated. This procedure was 
the usual one followed by this hospital in ad- 
ministering ECT. Treatments were scheduled 
three times a week until a full course had 
been run. Since it had been the experience in 
this institution that 20 convulsive reactions 
on the Reiter machine were usually required 
to induce approximately the same therapeutic 
result as that induced by 12 convulsions on 
the conventional type machine, each patient 
in the Reiter group received 20 and each one 
in the Conventional group 12 treatments. In 
a few instances, because of mechanical and 
other difficulties, single interruptions of the 
treatment rhythm resulting in intervals of 
four to seven days (instead of the expected 
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two to three days) were unavoidable. These 
occurred only once for any one patient, in- 
volved four individuals in the Conventional 
and nine in the Reiter group, and tended to 
be longer in the latter group. Later it will be 
shown that these single interruptions did not 
alleviate the detrimental effect of ECT. One 
patient in the Reiter group received her six- 
teenth treatment on a Medcraft (conven- 
tional) machine. 

Sampling. The two groups of 20 patients 
each were matched for age, education, and 
intelligence. The mean age of the Reiter 
group was 30.40 years with a Tange of 21 to 
52 years and an SD of 9.15; the mean age 
of the Conventional group was 34.35 years 
(range 20 to 59 years and SD of 9.59). For 
the Reiter group the mean number of years 
of education was 9.70 with a range of 6.50 


for the Con- 
with a range 
of 2.89. The 
Was used to 
ould approxi- 


There were 9 me 
group and 8 men and 12 wo 
tional group, Psychiatric diag 
group were distributed as foll 
action, 15 (of which 4 were of 
paranoid state, 2; į 


n and 11 w 


1 group 
phrenic reaction, 16 (of which 
aa a Paranoia state, 1; involutional 
psychotic reaction, 1; manic-depressive Pletion s 

pressive type, 1; and depressive Teaction, 1 Non of 
the patients had received any type of Semin. 
treatment within the previous Year; no case mith 
known brain damage was included. 

It was not possible to match 
severity of illness, and selection from this Point of 
view was necessarily at random, However, certain 
rough checks may be applied. Duration of illness js 
not significantly different in the two groups: 9 pa- 
tients in the Reiter and 8 in the Conventional group 
had been ill for one year or less; comparable figures 


schizo- 


the two groups for 


Barbara S. Kendall, Warren B. Mills, and Thomas Thale 


when the criterion is two years are 12 and 10. = 
index of Wechsler-Bellevue scatter which Pascal an 
Zeaman (8) have shown to differentiate between se 
grees of severity of psychiatric illness yields men 
of 9.35 for the Reiter and 8.06 for the Con een Ors 
group; the difference is not significant (¢ equa 
1.01). 


Psychological tests. In order to cng 
the amount of postshock confusion two eo 
test batteries were set up, to be administered 
on the day of the first treatment, on the aay 
when half the course of electroshock was e 
pleted (in the case of the Reiter group gn. we 
tenth treatment day and for the ova 
8toup on the sixth day), and, finally, on 
last day of treatment. 


The first battery, consisting of short tests a 
ture Absurdities (7), Substitution (7), Cancel vari- 
(Whipple), and Cube Imitation (Knox), was dwi 
ably given 30 minutes after the convulsion, an cond, 
be referred to as the Morning Battery. The pi a 
used (with few exceptions) three to three ‘d the 
half hours after the convulsion, will be mn in 
Noon Battery; this included naming the ae A 
reverse, subtracting serial 7’s (9), and seria pat- 
naming colors (9), duplicating from moO ia a 
terns of colored blocks (9), and identifying revi- 
pack of 15 cards 5 which carried words just p 
ously used as stimulus words in an opposite 
(5). Two patients in the Conventional group» 


I n a other 
an aggressive chronic paranoid and the erate 


catatonic in her first episode, refused to cooP 
in the Noon Battery on the first shock oa the 
Save adequate cooperation three hours Pors of 
second treatment. Where possible, alternate use 
the tests of these batteries were arranged for come! 
the second and third sessions. No change, Furdi- 
Practicable jn Months Reversed, Picture 

ties, Cube Imitation, Color Naming, or the shifting 
Blocks; but slight changes were made by ent let- 
the key in Substitution, crossing out a differ ifferent 
ter in Cancellation, and beginning with @ Recos- 
number in Serial 7’s and Serial 3’s; for the posites 
nition test the subject was asked to find onset of 
or a new set of words. Thus, although tra nce of 
training could not be eliminated, the inaner the 


i o 
previous practice was minimized for half case a 
tasks without introducing, except in the lence ° 


cognition, a real uncertainty about equiva 
culty. 


of 
In order to have a measure of the rate on 
recovery from the temporary intellects ivé 
efficiency which is the immediate cumu scale 
effect of ECT, the Wechsler Memory i 
Form I was administered to all patients pal 
mediately after the Noon Battery on the rost 
shock day, and this was followed apP 
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mately two weeks later with Form II of the 
Same scale. Longer-term losses and gains in 
intellectual efficiency which resulted from 
the treatment were evaluated by means of 
the Wechsler-Bellevue Scale. When possible, 
Form I was given before the first shock, and 
Form II 13 to 15 days after the last shock. 


Results 
Measures of Postshock Confusion 


In the analysis of results T scores were 
Computed, according to the method of Mc- 
Call, for each subtest of the Morning and 

oon Batteries, and these were based (with 
one exception) on all three performances of 
oth §roups in the same or equivalent tasks. 

he Recognition test was given after the first 
and final shocks only, and, consequently, 80 
scores, instead of 120, were used in the calcu- 
ations. It would not have been useful to score 
the subtests of the battery by already estab- 
‘Shed norms (where these existed) because 
© scores earned after ECT tended to ac- 
cumulate at the lower end of each distribu- 
ton to an extent which precluded effective 
differentiation, It was also undesirable to 
normalize for each administration separately 
rcause the scores would have failed to show 
the €xtent of the changes which occurred in 
ia COUrse of treatment. The method chosen, 
©, the Normalizing of scores of each subtest 
or all three administrations, does not repre- 
an attempt to establish standards of per- 

Mance, but is rather a means of providing 

asis for comparisons between Reiter and 
s ventional groups and among the three 

Ministrations of the subtests. . 
e n Table 1 mean scores for each group in 
och Subtest administered on the first day of 

atment are compared with mean scores for 

°se given on the last day of treatment, and 
5 “toss comparison is made of the differences 

“tWeen gains and losses shown by both 
Soups. Means were computed for midcourse 
an Surés, but, since they add little to the 
‘alysis, are not included in the table. 

hanges induced by ECT. Test-retest 
Anges are considered separately for each 
Perimental group. Decrements significant 
Ean beyond the 2% level of confidence oredr 

groups in Substitution and Serial 7’s, 


ex 
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and at or beyond the 5% level in Cancella- 
tion. For one or the other group losses sig- 
nificant at or beyond the 1% level åre found 
in Picture Absurdities, Serial 3's, and Recog- 
nition, and at the 5% level in Cube Imita- 
tion and Months Reversed. Thus 8 of the 10 
subtests are shown to be more or less sensi- 
tive to the cognitive changes induced by 
ECT. In the case of Color Naming, however, 
the effect of previous practice appears to 
cancel out the damaging effect of ECT; and 
Block Design actually shows a gain, though 
for the Reiter only, which is significant at the 
59% level. 

Test of Hypothesis I. The difference in 
gain and loss from first to final shock is ex- 
pressed as the average change for Reiter 
minus the average change for Conventional. 
A comparison of the two groups with regard 
to these score decrements or increments yields 
only one significant difference, that for Rec- 
ognition. A possible reason why this test of 
memory and alertness made the differentia- 
tion where the other tests of postshock con- 
fusion failed to do so is that transfer of 
training is more successfully minimized for 
this task than for any of the others, partly 
because a new set of stimulus words is used 
in the retest, and partly because the mid- 
course retest is omitted. It may be that for 
the other subtests the effect of previous prac- 
tice offset in some degree the effect of con- 
fusion, but in a test of new learning the 
Reiter group was better able to demonstrate 


superiority. 


Memory Scale 

Changes in first two weeks of recovery pe- 
riod. In contrast to the experience with tests 
used to measure changes taking place during 
the course of treatment, practice effects in the 
case of the Wechsler Memory Scale, which is 
used as a measure of recovery, tend to inflate 
the retest scores and make the differences 
artificially greater. In Table 2 the mean 
Memory Quotients on the last day of ECT 
are compared with results of a second ad- 
ministration two weeks later. For both groups 
the test-retest gains are significant beyond 
the 1% level of confidence. 

Further test of Hypothesis I, While the 
majority of the tests of postshock confusion 
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Table 1 


Measures of Postshock Confusion: 
* 


Means, Sigmas, and Measures of Difference in 


Reiter (R) and Conventional (C) Groups (T Scores) 


First shock (1) Final shock (3) 
"Di, i 
Test Mean Sigma Mean Sigma 1-3 t Dr—De 
Morning battery 
Picture Abs. 63 
R 52.60 6.04 46.20 9.35 6.40 2.86*** 2.10 ü 
c 52.10 7.30 47.80 9.28 4.30 1.76 
Substitution 35 
R 54.60 11.04 45.85 9.52 8.55 3.88*** 1.25 : 
C 53.90 9.43 46.40 8.27 7.50 2.72** 
Cancellation 13 
R 52.30 9.23 47.25 9.71 5.05 2.12* —.40 ` 
G 53.05 934 47.60 9.91 5.45 2.75** 
Cube Imitation 23 
R 5440 8.61 50.05 8.86 4.35 2.21* 85 i 
c 49.40 10.45 45.90 9.33 3.50 1.13 
Noon battery 
Months Rev, 2 
R os 10.79 48.15 11.50 5.60 2.32* 2.60 i 
.95 9,28 5 i 
Suite 47.95 8.64 3.00 2.02 n 
z 54.95 10,78 48.30 918 6.65 4.21% 1.65 a 
a, 52.00 10.27 47.00 7.93 5.00 4.23*** 
R 50.60 12.69 49.10 8.77 1.50 59 —2.20 7 
C 51.35 9.63 47.65 8.56 3.7 29% 
Color Naming : ý w9 sag 7 
x 51.05 13.00 48.63 10.62 2.42 1.08 — 58 d 
Blocks AS 10,25 48.15 8.26 3.00 1.18 
R 1.15 
5 pe w 52.90 985 635 2.42* —3.75 
Recognition d 50.15 3.44 —2.60 1.35 wt 
R 51. 5 2.72 
ic ea cos 53.60 926 260 1.01 —9.80 
j 43.50 7.19 7.20 2.86%* 


* Significant at the 5% level of 
ry Significant at the 22 leve] Of connect: 
+ Significant at the 1% Je y 


Note.—Means are rounded, ty ongonfidence, 


fail to bring out clear-cut differences b 
etwee: 
the effects of the two methods of administer. 


ing ECT, results for the Wechsler Scale on 
the final shock day give striking evidence 
that the Reiter group shows less Cognitive 
disturbance. Significance beyond the 1% level 
of confidence is indicated, 

A comparison of subtest sc 
that the Reiter group surpasses the Conven- 
tional in several measures of new learning, 
ie., in Logical Memory, Memory for De- 
signs, and the “hard” items of Associate 
Learning; differences of 2.73, 1.90, and 1.05 

+ 


Ores reveals 


1% 
a e 
are significant (in the first instance at the -4f 


level ° 
level, and for the last two at the 5% 


108, 24 
Confidence) ; ¢ is, respectively, 2.90, 2-0° pe- 
2.10. No 


other difference in subtest $ cotin 
tween the two groups (except in Orien 
approaches statistical significance. hed 1% 
Because the two groups are mate ssu ed 
intelligence, age, and education it is “inis ra" 
that differences found at the first oo rence 
tion of the Memory Scale reflect g ia m 
in the amount of cognitive impairme’ | to 
duced by the ECT series. An atten by 
match the groups for the memory fa¢ 


— r 
Seay 


t 


i 
— —> 
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Table 2 


Measures of Recovery from Postshock Damage: Means and Sigmas in Reiter (R) and > 
Conventional (C) Groups 


Pretreatment (I) 


Final shock (I) After 2 wks. (II) 


Test Mean Sigma Mean Sigma Mean Sigma 
Wechsler MQ E 
R 76.95 11.36 90.60 20.28 
er Cc 66.55 8.86 81.90 16.95 
oo IQ 
N 20) 98.85 12.68 95.05 13.26 
C(N 16) 103.31 12.27 99.50 10.16 
C(N 17) 103.47 11.92 
C(N 19) 96.42 13.30 
Differences and their significance 
I—II t RI—-CI ¢ RII—CII ¢ Dr—De & 
Wechsler M 
R 8 —13.65 3.47** 10.40 3.15** 8.70 1.44 —1.70 32 
W E —15.35 4.39** 
echsler-Bellevue I 
R ue TQ 3.80 189 -4.62 111 S 3! -0.01 01 
¢ 3.81  2.19* 


* Sieni 
vey SiBnificant at the 5% level of confidence. 
gnificant at the 1% level of confidence, 


J á 
Note.—The Wechsler- Bellevue data for the Conventional g 


Onl; 
berg gu" subtests prior to shock; a fourth refused the posttest Pe 
Patients who gave full records in the different situations. 


ro the scale as a pretest or as a posttest 
Driseq have been illusory. The groups com- 
and th a variety of psychiatric conditions, 
t st. € schizophrenic patients were in differ- 
ny ages of the illness from acute to chronic. 
ave peresi other than vocabulary, would 
intel allen far short of representing inherent 
Ds €ctual endowment. The remission of the 
Ychosis brought about by ECT should be 
tximal immediately after the conclusion of 
be i ries, and its effect more nearly equal 
dts Patients than at any other time, but 
hiti effect was essentially nullified for cog- 
Which tests by the intellectual impairment 
Wi all the experimental patients suffered. 
° weeks later, when the retest was made, 
eee Patients had begun to lose the benefits 
thane from the treatment while others 
the ‘ined their gains. In either situation 
fo ; Stablishment of approximate equivalence 
e two groups in a sensitive measure was 

attri ee Matching for the more stable 
utes of vocabulary, age, and education, 


a Pugh not ideal, was the most that could be 
Chieved, f 


roup are incomplete; one patient was mute and two had been given 


rformance Scale. Differences are calculated for the varying num- 


Test of Hypothesis II. Two weeks after 
the last treatment the difference between the 
means of the two groups in the Memory 
Scale, though not greatly diminished, is no 
longer statistically significant, and the dif- 
ference in the extent of test-retest changes, 
i.e., in mean gains or losses, is negligible. A 
wider spread of scores, shown in what is al- 
most a doubling of the standard deviations, 
reflects a variability in immediate outcome. 
Stone (11) has found the Wechsler Memory 
Scale to be “remarkably sensitive” to the 
temporary intellectual impairment associated 
with ECT. It seems also to be sensitive to 
changes which, in those cases which derive 
no lasting benefit, are associated with a re- 
activation of the psychosis for which a tempo- 
rary remission has been effected by ECT. Ten 
patients of the Reiter and 12 of the Conven- 
tional group had improved sufficiently to be 
slated for an early discharge. Among the 
remaining patients, three were signed out 
against advice, a few were discharged later, 
but others required long-term care. The mean 
gains for the “good” outcome group—20.00 
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—and for the “poor” outcome group—7.78 
—differ by 12.22 points, and this difference 
is significant at the 2% level. . 

Effect of interrupted treatment. Since the 
amount of gain shown in the final administra- 
tion of the Memory Scale might be thought 
of as a rough measure of the extent of im- 
pairment of brain function which resulted 
from the full course of ECT—impairment 
which was actually reversed in the two-week 
period following treatment—an attempt is 
made to use this measure to determine 
whether the patients whose courses of treat- 
ment were interrupted had suffered less tem- 
porary detrimental effect as a consequence. 
Eleven patients in the Reiter group who had 
uninterrupted treatment were compared with 
9 in the same group for whom 4-, 5-, and 7- 
day intervals occurred once for each case. 
The mean gain for the former group was 5.45 
and for the latter 23.66; the difference is sig- 
nificant at the 2% level (¢ = 2.67), but is not 
in the anticipated direction. This difference 
is not explained by differences in intelligence 


t inferiority in the 


gence (the product-moment correlation þe- 
tween gains and Vocabulary score being .40, 
significant at the 1% level of confidence), 


group 
ment” 
ot sig- 
to ex- 
le cog- 
ose pa- 


4 one un- 
duly long rest interval, was spread Over a 


longer period of time. There is no evidence 
that these brief interruptions Operated to al- 
leviate the disrupting effect of treatment, 


B. Mills, and Thomas Thale 


Wechsler-Bellevue Scale 


Changes pre- to postshock. Also in Table ‘ 
are shown mean IQs and their standard devia 
tions for two administrations of the ise 
Bellevue Scale; Form I was given before tl ° 
start of ECT and Form II a fortnight a 
its completion. Though in individual a 
the changes may be marked (the range d) 
ing 30 IQ points lost to 9 IQ points gaiei 
for each group as a whole a slight aam 
is found on retest, which is significant, at na 
5% level, in the case of the Conveni ie 
group and approaches significance 7 
Reiter group. The experience of Cerbo tat 
and of Hayes and Schneider (4) suggests ae 
with normal subjects a negligible gain Tes ex- 
when Form II follows Form I. Here ce 
pectation would be that remitting psy¢ ee 
Present in more than half the cases, W re- 
bring about an increase in scores, but, Pil 
sumably because after two weeks there tions; 
residual impairment of cognitive fumigene 
this effect is not found. Confirming ev! esen 
that intellectual loss might still be Prati 
on retest is brought out in one qua ‘whic 
feature, a difficulty with word fading g 
occurred in a few instances. In ESRO tra & 
Picture Completion two weeks after t oug? 
of the shock series, four patients, under 
they indicated by pointing that they re wir 
stood what was missing in item 3, wether’ 
able to recall the word hinge, and 2 rofl 
recalled it only after a marked hesita ae 

Test of Hypothesis III. The differe ert? 
tween the experimental groups sti 7-Belle: 
changes (gains or losses) in Wechs ratio 8 
vue IQ from first to final administri pe 
negligible. Therefore the hypothesis reat 
to postshock average gains would wid pa” 
and average losses less, for the Rete ped: 


K stai” 
for the Conventional group is not st 


Summary ect 


ff 
4 al e 
In order to compare the detrimenti 7 
on cognitive functions of two differ f 2 


Patients each, matched for age, €d" 
and intelligence, were subjected to 
first group to 20 convulsions by t” m 
method, and the other to 12 convulsi0’ epo 
the Conventional method. Various P 


-P 
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logical measures were used before shock, dur- 
ing the course of shock, and two weeks post- 
shock. 


At the close of the treatment period less 
Cognitive disturbance, as measured by cer- 
tain tests involving new learning, had oc- 


Curred in the Reiter group, but differences 
Were negligible for other tasks. In the two- 


Week postshock period gains in the Wechsler 
Memory Scale were approximately equal for 
the two groups. Comparison of pre- to post- 
Shock average changes in the Wechsler-Belle- 
Vue Scale gave no advantage to either group. 


Received January 24, 1956. 
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Group Psychotherapy with Chronic Psychotic 
Soiling Patients’ 


John E. Tucker 
VA Hospital, Albany, N. Y. 


The frequency for the 20 Ss was 
measured in a 15-day pre-experimental period 
s kept by trained 


quencies, and mental-al 
not Statistically differe: 
(critical ratios for Ma 


1An extended report of this study ma 
tained without charge from 
Hospital, Albany, 


y be ob- 


Publicatio; 


> ns Project, 
Photoduplication Service, Library of Cong 


Libra ress, Wash- 
ington 25, D. C, remitting in advance $1.25 for 
ein or $1.25 for photocopies, Make checks 


payable to Chief, Photoduplication Se 


rvice, Library 
of Congress. 


hanges 
by feeding the Ss sweets. No M they 
were noted in Ss’ psychotic Pa eE and 
showed friendliness toward the ae achieve 
did not resist group meetings. The e as shown 
Some psychological group rae formation 
Y consistent choice of seats, the 


* an 

+ nchiDS 

of submissive-dominant relationships, 
some role-taking, : riod the 
During the 9-wek experimental perio t 


did 2 

20 Ss stayed on their usual ward mer es- 
have any change in their living 10 expeti 
cept for group therapy for the 10 controls 
mental Ss. The identities of the ~~ The 
were concealed from ward p he pawel be 
tally of soiling was kept over me of the P? 
riod for both groups. At icen data We? 
riod the pre-experimental mi i mea? 
compared with postexperimenta. A oj de- 
gain differences were analyzed. verage: P 6 
creased 1.1 in their daily soiling is The $ 
Perimentals decreased 6.7 in pat grou? 
difference favoring the Re ei les 
mean gain was statistically signi a 
than .05. eS 

‘The sekiin and matching pori pati 
bodied in the design encourage t oiling y 
sis that the greater reduction in alte 
havior in the experimental Ss pan m 
stoup therapy. Possibly, group i i n0d 
a sufficiently potent technique ch as t% i 
early learned behavior patterns a other n 

abits. Use of group therapy ae in psy¢ e 
havior pattern disturbances foun ss or el0P 
atric hospitals such as assaultivene 
ment suggests itself. 
Brief Report. 
Received July 24, 1956. 
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The Short-Term Effects of Chlorpromazine on 
Psychiatric Patients 


William D. Winter and Wilbur K. Frederickson 


Hospital jor Mental Diseases, Milwaukee, Wisconsin 1 


me increasing use of chlorpromazine and 
er tranquilizing drugs in the treatment of 
een disorders poses practical and theo- 
Sone Problems for the clinical psychologist 
dru ing in this area. Experience with these 
ee demonstrated their efficacy in mak- 
redu isturbed patients more manageable and 
de the need for restraints, sedative 
tion S, and seclusion (5). Used in conjunc- 
pl with psychotherapy, the drugs have re- 
Placed to a large extent the more drastic 
ock” therapies as the treatment of choice. 
ion exact physiological and psychological ac- 
unk Produced by these drugs is still largely 
on own. We see clinically a reduction of 
in ae agitation, and emotional lability 
nab] € patient which makes him more ame- 
mine, to psychotherapy. It is still undeter- 
Eai whether these reactions indicate that 
in i personality changes are being effected 
enabl, individual or whether the drugs only 
nor, € the patient to work out his problems 
e effectively by lessening the confusion 
intense emotionality set off by unbear- 
Conflicts, 
Drelin e purpose of the present study will be a 
Derg, minary investigation into the nature of 
Pro mbit changes produced under chlor- 
inf a, as measured by ward behavior 
is t Psychological tests. Our first hypothesis 
Besar within a week’s time no significant 
test Dality trait changes, as measured by the 
Ur used in this study (MMPI), would oc- 
as a direct result of chlorpromazine treat- 


able 


1 
of authors wish to express their appreciation 
sty dy E Eeg given them in carrying out this 
v. Y Christine Ivanov, M.D., Donald Schaefer, 
Staft “rent Lichtenstein, M.D., and the nursing 


this hospital, 


ment. We, however, predict an improvement 
in overt ward behavior, related to a decrease 
in subjective anxiety. 

Another general problem investigated, a 
practical one for psychologists, concerns the 
validity of administering tests involving 
visual-motor coordination to patients under- 
going chlorpromazine treatment. In this hos- 
pital most patients are routinely put on some 
form of drug therapy a few days after their 
admission. Physical symptoms due to the 
physiological action of the drugs occur shortly 
after the patients begin this therapy. These 
symptoms usually include blurred vision, diffi- 
culty in coordination, and dizziness. A test 
involving visual-motor coordination, such as 
the Bender-Gestalt test, can be expected to 
be particularly vulnerable to misinterpreta- 
tion if the side reactions to the drugs signifi- 
cantly affect test performance. Our testing 
experience with patients undergoing drug 
therapy led us to predict that tests involving 
a visual-motor task would be contaminated 
by the physical side effects of the drug. 


Methodology 


The subjects used in this study were 59 
female patients newly admitted to the Mil- 
waukee County Hospital for Mental Dis- 
eases. These patients represented a variety 
of diagnostic categories, but all those with 
known or suspected organic impairment or 
those in need of emergency care were ex- 
cluded from the sample. The age range of the 
subjects was from 18 to 45 years, with a 
median age of 33.5. The median educational 
level was 11.5 years of schooling, and the 
median mental age was 15.5, as estimated 
from the Shipley-Hartford scale. 
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The test battery included the Bender- 
sestalt test, the group form of the MMPI, 
nd the Shipley-Hartford scale. The Gardner 
3ehavior Chart (8) was used to estimate ad- 
ustment to ward routine. A check list show- 
ng the deviation of the patient’s drawings 
from the stimulus figures was used to score 
the Bender-Gestalt test. This check list was 
developed by the authors at the suggestion 
of Max Hutt. This list incorporates many of 
the items in Pascal and Suttell’s scoring sys- 
tem (6), and also includes deviations such as 
constriction and overexpansiveness, which are 
found in Hutt’s criteria (4). Unlike Pascal’s 
system, differential weighting of specific devi- 
ations was not attempted. Scoring reliability 
for this check list was found to be .91. The 
scoring of the MMPI followed the practice 
of adding the designated percentage of K to 
the necessary diagnostic scales (3). 

As patients were admitted to the hospital, 
they were randomly assigned to two groups. 
Both groups received placebos, which were 


tablets in 
the end of 


tients in the Drug group began receiving 50 
mg. tablets of chlo 


times a day, and 


tinued getting placebos. Seven days iten 
both groups were retested on the Bender a 3 
MMPI and another Gardner Rating poe 
was filled out. The Shipley-Hartford apt 
was also administered at this time. n ire 
time did the physicians, nurses, or paye cn 
gist doing the testing know which of the 
coded treatment routines involved the tes 
chlorpromazine. The Bender records hic 
coded so that the scorers would not AlE 
whose test was being scored or — tail 
protocol was from the first or second 
administration. if- 

The two groups were not significantly a 
ferent on the variables of age, oe 
telligence, number of admissions to the 
pital, or diagnostic category. 


Results 


In Table 1 are listed the test-retest Te 
ability coefficients for each of our a ene 
with the time interval of one week be the 
tests. These correlations are based ena 
scores of the drug and placebo groups reli- 
bined, and are similar to the foal 
abilities found in previous studies (1, rou? 
The median reliability for the par 
alone was .75; for the drug group, -7 scores 

The changes occurring in the ae 
Over a one-week period are given in 


Table 2 


er -Weck 
Significance of Changes Occurring in a One 


Period for Entire Sample 
Table 1 
Test-Retest Reliability Coefficients Mean 
= sete r 
on first NaS" 

Measure N r Measure N testing change z a 
Ward Ratings 51 ~ 3 
Bender-Gestalt 44 Ps Ward Ratings 51 36.8 ee <0! 
MMPIT Scores i Bender-Gestalt 44 215 me 20 

L 31 MMPI T Scores L. 

-18 5 41.7 ‘20 
F 31 76 L 31 57.2 i9 <io 
K 31 : p 31 60.1 ery 5 <. 0 

65 K 31 594 +2 <A 
a > -76 Hs 31 58.6 -12 22% 
D 31 79 D 31 s2  —32 20 
Hy 31 .66 H 31 65.2 -28 z0 
Pd 31 71 By Ši 720 —47 Z230 
Mf 31 .63 Mf 31 547 ati 2.30 
Pa 31 75 Pa 31 590 —19 Z0 
Pi 31 86 PL 31 63.0 —3.9 202 
Sc 31 17 Sc 31 652 -41 Z2 
Ma 31 65 


OF 


—jer 


Short-Term Effects 


for the entire sample. Change was computed 
by subtracting the first test score from the 
second test score of each subject, and the 
significance of this difference was determined 
by the use of two-tailed ¢ tests for correlated 
data. As can be seen from the table, our sub- 
jects as a group showed significant improve- 
ment in ward behavior and Bender-Gestalt 
scores, and a significant decrease on the 
Psychopathic Deviate, Psychasthenia, and 
Schizophrenia scales of the MMPI. They also 
showed a tendency toward a higher K score 
on the MMPI at the time of their second 
testing. 

Inspection of the data revealed that the 
two groups differed significantly on several 
MMPI scales on the original testing, there- 
fore, the drug and placebo patients were 
Matched as closely as possible on the basis 
of their initial scores on each measure, in 
order to determine which group changed 
More in one week’s time. Comparison of the 
Mean changes of the two groups by use of 

e€ £ test for uncorrelated means revealed 
only three variables in which the differences 
*bproached significance at between the .10 
ee level of confidence. The patients re- 
in ving drugs improved more than those tak- 

E placebos on the Ward Ratings, and the 
Placebo group improved more on the Bender. 
ae drug group showed significantly higher 
mates on the K scale of the MMPI The 
i mber of subjects compared on Ward Rat- 
ae was 42, on the Bender-Gestalt 32, and 

he K scale 22. 


Discussion 


pes nalysis of the data indicates that in a 
Sh iod of one week the patients as a group 
Owed small but statistically significant 
hanges in Ward Behavior ratings, Bender- 
stalt scores, and on several MMPI scales. 
Peris is congruent with our own clinical a 
With oe with acutely disturbed patients, i 
sett the result of other studies (T); the 
erity of their symptoms often decreases 
aa edly after only a few days of hospitali- 
tna The problem of the depth and per- 
pl nence of these changes cannot be com- 
etely solved. Tt should be pointed out that 
ine data are limited and we cannot precisely 
aluate the effects of practice, the lack of 
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independence of the MMPI scales, the short 
time interval, and the use of only a-moderate 
drug dosage. 

When we compare the mean changes of the 
drug group with those of the placebo group, 
we do not find any outstanding differences. 
There is a trend, however, for the drug group 
to show better ward adjustment, poorer Co- 
ordination on the Bender-Gestalt, and a 
higher K score. The first two findings are in 
the predicted direction. The use of chlorprom- 
azine reduces subjective anxiety and exces- 
sive emotional lability, which makes the pa- 
tient easier to get along with and more 
approachable. At the same time, particularly 
in the early phases of drug therapy, the pa- 
tient suffers from many side reactions such 
as dizziness, blurred eyesight, poor coordi- 
nation, and physical unrest, all of which 
could easily affect performance on the Bender- 
Gestalt test. 

Apparently none of the usual diagnostic 
scales on the MMPI were differentially af- 
fected by the drug. The test-retest reliability 
figures for the two groups on the MMPI are 
similar to those cited in the MMPI manual 
and in other studies (3, 7). This suggests 
that the use of chlorpromazine therapy with 
the patients resulted mainly in superficial 
behavioral improvement which may have in- 
volved a suppression of symptoms rather than 
deep personality changes. There could, of 
course, be an increase in ego strength which 
may lead to eventual major changes in per- 
sonality structure, but the data shed no 
light on the question. It is interesting that 
other studies in this area have shown little 
or no change in psychological tests after drug 
therapy despite such overt changes In be- 
havior as to markedly lessen the need for 
sedative packs, electric shock, seclusion, etc. 
Oe cco should be made concerning the 
need for using control groups when doing re- 
search in this area. As mentioned above, a 
certain percentage of acutely ill patients, 
even when not given any special kind of 
treatment except for routine hospitalization, 
tend to get better. When control groups can- 
not be used, it is easy to attribute this im- 
provement to whatever therapy is being ad- 
ministered. In one case a physician hesitated 
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about putting a patient on the project be- 
cause she was quite disturbed and he wanted 
her to receive electric shock. She was never- 
theless placed on the project where she made 
spectacular improvement in her ward behav- 
ior. The physician was reassured that the pa- 
tient was at least getting some drug therapy, 
but a later check of the records showed that 
the woman was in the placebo group. Thus 
the physician was falsely attributing her spon- 
taneous (i.e., of unknown cause) recovery to 
the action of the drug. 

In interviews with 


drugs,” and every patient Was exposed to the 
d to the 


d 2 to 
-1 rug group from —4 to 


improvement 
bservation, 7 
Summary 
A group of acutely 
tients was tested before and after 
chlorpromazine therapy, and the tee of 
test scores were Compared with i ih 


disturbed female pa- 


William D. Winter and Wilbur K. Frederickson 


control group which received only placebos. 
The combined groups showed small but sig- 
nificant changes in Ward Ratings, Bender- 
Gestalt test scores, and on the Pt, Pd, St, 
and K scales of the MMPI. When patients 
Were matched on their original score for each 
measure, the data showed a trend of the drug 
group to improve more in Ward Ratings and 
increase more on K, but to do less well on 
the Bender-Gestalt, Our conclusions are that, 
in general, acutely disturbed patients tend g 
improve after a few days of hospitalization 
and that chlorpromazine speeds behaviora 
adjustment to ward routine, but that it am 
some disruption of coordination, especially 
during the so-called “turmoil phase” at t x 
beginning of treatment. Evaluation of psy” 
chological tests involving visual-motor E7 
ordination, such as the Bender-Gesta 
should, therefore, take into account the è 

fects of concurrent drug therapy. 
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Use of the Proverbs Test for Differentiating 
Schizophrenics from Normals’ 


Donald R. Gorham 
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oF oles Proverbs Test (10), the subject is 
na tell the meaning of a proverb. For 
Srader. subjects, even as young as fifth 
e this request readily stimulates what 
hee refers to as the “abstract attitude.” 
Crete © the process of translating the con- 
con symbols of a proverb into generalized 

Cepts is almost explicitly described in one 

sGoldstein’s characterizations of abstrac- 


In t 
meq: he 
we 


iatel abstract attitude, we transgress the im- 
RDSE given specific aspect or sense impression; 
Ursely, ract from particular properties. We detach 
vidual m from the given impression, and the indi- 

thing represents to us an accidental sample 


r 
*Presentative of a category (7, PP- 18-19). 


Benjamin (3) believed that the breakdown 
a rbal abstraction so commonly present in 
erbg ophrenia could be investigated by prov- 
of t Goldstein (8) claimed that the findings 
Whi e test for abstraction and concreteness 

ch he and his associates had developed 


Or 3 dl 
Investigating organic damage had rele- 
a hrenia and 


i ior f ith schizo 

Do esearch with schizop 

e out the need for more measures of 
mraction, 

Par, 7 clinical Proverbs Test consists of three 

$ a forms containing 12 proverbs each, 

€d in the order of difficulty. Samples are: 


of 


: Rome was not built in a day. 
hen the cat's away the mice will play. 
` ¢ £ Wife is the key to the house. ° 
Peech is the picture of the mind. 
i etter be happy than wise. 


ine more cost, the more honor. 
1 
A *, 

the See presented at the annual meeting of 

Teza Uthwestern Psychological Association, Dallas, 


S, March 23, 1956. 


Qaepene 


An abstract (Ad) score on this form of the 
test is secured by rating the items according 
to sample scores for each proverb. 

The multiple-choice Proverbs Test consists 
of 40 items with four answers each. It is 
scored by stencil. An abstract (Ab) score 
consists of the total number of correct re- 
sponses. A concrete (Co) score consists of 
the number of items marked from 18 “con- 
crete” answers. Samples of an easy and a 
difficult item are: 


1. The sun shines upon all alike. 
a. It’s the same sun everywhere. 
b. All are created equal. (Ab answer) 
c. The sun shines on everybody. (Co answer) 
d. People that do the same things are alike. 
. The good is the enemy of the best. 
a. Get the best of your enemy whenever you 
can. 
b. It is best to be good even if you fail. 
c. We should love our enemies. 
d. Most people are too easily satisfied. (4b an- 


swer) 


tv 


The Proverbs Test seems to possess use- 
ful qualities as an instrument for measuring 
impairment of conceptualization in schizo- 
phrenia. It gives a relatively pure measure of 
“verbal Comprehension” as evidenced by 
high correlations with tests heavily loaded 
with this factor (9, p. 7). 

These considerations led the author to ex- 
plore the possibilities of utilizing the Prov- 
erbs Test to investigate impairment in ab- 
straction in schizophrenia and to differentiate 
schizophrenics from normals. Reliability stud- 
ies indicated that the test was satisfactory 
when the subjects were hospitalized schizo- 
phrenic patients (10). As samples of schizo- 
phrenic populations were gathered, it be- 
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came apparent that their Proverbs Test 
scores were generally lower than those of 
normals. Since test scores are so closely cor- 
related with intelligence, however, this factor 
had to be controlled before it could be de- 
termined whether an actual difference existed. 

A pilot study was made in which 78 nor- 
mal subjects were compared with 118 chronic 
schizophrenics, Analysis of covariance was 
used to hold intelligence constant and the 
Wechsler vocabulary subtest was used as the 
measure of intelligence. The analysis yielded 
an F of 14.30 which js significant at the .001 
level of confidence, This finding seemed to 
justify a rigid test of the variation of scores 


on the Proverbs Test between schizophrenics 
and normals. 


Method 


From a sample of 332 Air Force basic air- 
men and 232 hospitalized schizophrenic vet- 
erans, 100 AF men were matched for Sex, 
education, and intelligence with 100 chronic 
schizophrenics, The Word Knowledge Test 
of the Airman Classification Battery was 


used as the measure of intelligence, 
pairs were matched exactly a 


Donald R. Gorham 


cils. Comparable scores for the ay 
(clinical) form of the test are secure Es 
individual scoring according to scoring rable 
ples for each proverb (9, 10). The s 
shows that the differences in the mean ior 
both the abstract and the concrete soma i 
both forms of the test are significant bey! 
the .001 level of confidence. at 

Since intelligence has been held a 
by matching each normal with each p iking 
on the Word Knowledge Test, the por 
drop from normal to schizophrenic nding 
on the abstract scores and the correspo. air 
rise in the concrete scores indicate an schizo- 
ment in abstraction resulting from on: this 
Phrenic condition of the patients. nega- 
connection it is interesting to note n A 
tive correlation between the abaa era 
concrete scores on the Proverbs ce 
independently derived. The coeflici ultiple- 
Correlation between the Co of the m Jinica 
choice test and the Ab score of the norma 
test were found to be — .58 for 109 schizo” 
subjects and — .54 for 173 chronic 
Phrenic subjects. 


s ication 
Cutting Points and Their Applica ss and 
Tn order to establish cutting points ‘ipe 


norms for use with the Proverbs ia an 
total available population of nor igen 

schizophrenics was divided into "ee word 
groupings according to scores on at dat? 
Knowledge Test. Such treatment 0 petwee” 
was necessitated by the correlation 


Table 1 


iminating Between N 
Intelligence Hel 


: vith 
ormal and Schizophrenic Men W! 


d Constant 
(100 matched pairs: N = 200) 
Air Force Chronic 
enlistees schi i 
izophrenics Mean 
—— difference : 
Test and score M sD M SD D : 
Multiple-Choice Test j smi 
Ab (Abstract) score 24.6 7.4 16.7 8.7 7.9 es al 
Co (Concrete) score 14 23 48 35 34 ane 
Clinical Test (Form I) amy 
Ais AEI Eie 11.5 63 5.2 6.5 6.3 34.45 Ko 
Co (Concrete) score 18 26 47 35 29 i 


a a 


Proverbs Test for Differentiating Schizophrenics 


Table 2 


A Comparison of Scores of Normals and Schizophrenics 
Means and SDs by Intelligence Groupings * . ’ 


Ab (abstract) score 


Co (concrete) score 


Test and score Mean SD N Mean SD 
p = alear ` 
Multiple-choice test 
High Intelligence (W.K.: 7, 8, 9) 
Normals 31.3 3.9 5 
rmals : 3. 58 7 
Schizophrenics 24.8 Fa 65 ee ee 
Middle Intelligence (W.K.: 4,5, 6) . 
Normals 22.8 5.4 3 
‘mals 22. t 136 
Schizophrenics 15.3 6.5 79 re za 
k 3. 
Low Intelligence (W.K. : 1, 2, 3) 
Normals 16.0 4.9 58 3 
Schizophrenics 9.6 5. 65 61 H 
Clinical test 
High Intelligence (W.K. : 7, 8, 9) 
Normals 19.2 2.6 58 0.2 0.6 
Schizophrenics 12.6 6.4 65 1.9 5.9 
Middle Intelligence (W.K. : 4, 5, 6) 
Normals 11.4 5.7 136 ia 1.6 
Schizophrenics 4.9 47 79 2.5 44 
Low Intelligence (W.K.: 1, 2, 3) 
Normals 4.0 4.0 58 3.1 2.7 
1.0 1.0 65 3.9 24 


Schizophrenics 


4 he publisher. 
ou the Word Knowledge Test, of 
ude the middle 54% and 1-3 incl 


m 
a k level and performance on the 
Btouping Test. The norms by intelligence 
cal ma gs are presented in tables in the clini- 
ese ate of the Proverbs Test (10). In 
als A es the mean score and SD of nor- 
each Sk schizophrenics can be compared for 
edge Te score group of the Word Knowl- 
in rakes Some of these data are presented 
o dente 2, which shows combined groupings 
Now] a 1-3, 4-6 and 7-9 on the Word 
equiva ge Test. These divisions are roughly 
and ] ent to the upper quartile, middle half, 
mal — quartile in a distribution of nor- 
ubjects. 
or he data in Table 2 were used as the basis 
or establishing experimental cutting points 
differentiating normals from schizophren- 


rmen from the Personnel and Training 
esentative sample of testable chronic hos} 
m norms in the clinical manu 


1 of Air Force basic aii 
on consisted of a repr 
Center. These data are taken fro! 

the A. F. Airman Classification Battery. 
Jude the bottom 23%. 


Research Center, Lack- 
pitalized veterans from 
al of the Proverbs Test (10) and 


The W. K. scores 7-9 include the top 


ics. Actually, a considerable amount of trial 


and error entered into the process. It was 
found that at the upper and middle intelli- 
gence levels, the abstract and concrete scores 
of the multiple-choice test could be used most 
efficiently in combination. This was not true 
at the low intelligence level, where the con- 
crete score had no usable differentiating value 
(see Table 2). The effectiveness of the cut- 
ting points when applied to a population of 
352 normals and 232 chronic schizophrenics 
is shown in Table 3. The fact that a substan- 
tial portion of these cases was included in the 
population from which the cutting points 
were derived should be taken into considera- 
tion in judging the effectiveness of this ap- 


plication. 
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Table 3 
- Application and Cross Validation of Cutting Points for Multiple-Choice Test 


Original sample 


Cross validation sample 


Schizo- Schizo- Total 
Group and cutoff scores Normal phrenic Total Normal phrenic 
High Intelligence (W.K.: 7-9) m 
Ab > 26 and Co < 2 86 2 108 48 6 30 
Ab < 26 and/or Co > 2 19 43 62 9 21 = 
aa a Pa pa ai 4 
105 65 170 57 27 : 
Middle Intelligence (W.K.: 4-6) 
Ab > 15 and Co <4 112 23 135 24 8 A 
Ab < 15 and/or Co > 4 29 56 85 4 22 ee 
— = — = = 8 
141 79 220 28 30 5 
Low Intelligence (W.K. : 1-3) 4 
Ab > 12 70 18 88 16 10 6 
Ab < 12 16 70 86 4 22 pe 
om = = — m 52 
86 
Combined Groups 88 174 20 32 
Predicted Classification 
Normal 112 
i : 288 63 351 88 24 2 
hizoph: 5 8 
Schizophrenic 64 169 233 17 65 a 
Pete ea ad an = 194 
352 232 584 105 89 
The table shows that th 
oie i ere were 64 false Cc idati 
; ross Validation P 
positives in the normal Population sample mult} 
and 63 false negative: 


for normals, 81%, 
and for the total 
77.5%. 


In attempting to establish i i 
for the clinical test, it was fone aens 
crete Scores could not be used successfully Pa 
combination with the abstract scores. The 
latter scores used alone, however, separated 
normals from schizophrenics with about th 
same degree of efficiency as the multiple. 
choice test scores. The application o 


73 %o 2 
Cases, 


: f the cut- 
ting points to the 100 matched pairs de- 
scribed earlier in this paper is shown jn 


Table 4. The table shows that there were 17 
false positives in the normal Sroup, 28 false 
negatives in the schizophrenic group or a 
total of 45 misclassifications in the total 
sample of 200 cases. The efficiency of the 
clinical test for this sample is thus 114%. 


The cutting points for use with the ! op 
ple-choice test were applied to a new p p 
lation of normals and schizophrenics } the 
der to cross validate the effectiveness ° con- 
measures. The new normal population al 
Sisted of 105 men and women in civilian yor 
civil service employment at a variety ° opt” 
cational levels. The new schizophrenic P 38 
lation consisted of 51 male veterans zA pe 
male and female chronic state hospita” |. 
tients. The results of the cross-validation jti- 
plication of the cutting points for the 
Ple-choice test are given in Table 3- 

The predictive efficiency of the CH so4 
points applied to this new sample zh the 
Cases was 78%—almost identical W! taine 
Original findings. The new sample COD! ipg 
men and women in both groups, COP™ rest 
the normative data on the Proverbs phe 
which showed no sex differences >, pew 
inclusion of state hospital patients in t cul 
sample indicates that the experimenta 


cuttin’ 


Proverbs Test for Differentiating Schizophrenics 
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Table 4 
Application of Cutting Points for Individual Test * 


Group and cutoff scores Normal Schizophrenic Total 
High Intelligence (W.K. : 7-9) 
Abstract score > 14 24 
Abstract score < 14 “5 A 3 
w 2 26 
Mid i x s = s 
Middle Intelligence (W.K. : 4-6) as 
Abstract score > 8 38 
Abstract score < 8 10 3i is 
a — eons 
Low Intelligence (W-K.: 1-3) = = 
Abstract score > 2 21 
Abstract score < 2 2 7 i9 
23 23 “46 
Combined Groups 2 
Predicted Classification : 
Normal 83 28 111 
Schizophrenic 17 12 89 
100 100 200 


chronic hospitalized veterans). 


*P 
o; p i n 
pulation ; 100 normals (Air Force basic airmen); 100 


ti 3 
a have validity when applied to 
Patient an the male veteran schizophrenic 
Wer s on the basis of whose scores they 
e evolved. 
s Discussion 
MaS questions are raised in connection 
ifferenti utilization of the Proverbs Test for 
sita lating schizophrenics from normals. 
Dle-ch, mparatively poor results of the multi- 
Stand oice test at the high intelligence level 
in he mi examination of the actual cases 
of th schizophrenic group showed that 56% 
Dhreni false negatives were paranoid schizo- 
ives me whereas only 34% of the true nega- 
ing ell in this diagnostic group. This find- 
the Points to the relative ineffectiveness of 
Teun ible. choice test for screening out 
t oid schizophrenics. ‘ 
cien is recognized, of course, that the effi- 
Cy of prediction is affected by the type 
pieg a eee to which the method is ap- 
norm; A population containing roughly 50% 
actu. Ps and 50% schizophrenics does not 
Do ally exist. If applied to an unselected 
ulation containing only 176 schizophren- 


schizophrenics (i 


ics, the predictive efficiency would be greatly 
reduced. On the other hand, if applied to a 
clinic population consisting entirely of peo- 
ple seeking assistance for mental and emo- 
tional problems, the predictive efficiency 
might well be enhanced. 

When used with schizophrenics, the free- 
answer Clinical test differs from the multiple- 
choice test in that it elicits psychotic mate- 
rial. In addition to concreteness in thinking 
which is associated with a breakdown of the 
abstracting function, the schizophrenic fre- 
quently “escapes” by a further regression 
characterized by “originality of performance” 
(1, p. 317). This is evidenced on the clinical 
test by responses characterized by autism, 
bizarreness, irrelevance, perseveration, and 
delusional preoccupation. Because of this free 
flow of schizophrenic material which is stimu- 
lated by this form of the Proverbs Test, diag- 
nosis of schizophrenia is sometimes obvious 
upon Clinical evaluation even though the ob- 
jective scores fail to properly classify the 


subject. 
It should be re-emphasized that the Word 
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Knowledge Test, which was used as the 
measures of intelligence in this investigation, 
is highly correlated with the Proverbs Test 
and gives a relatively pure measure of “ver- 
bal comprehension” (9, Table 3). Other test- 
ers will find the basic data for establishing 
intelligence divisions and cutting points suit- 
able for their own purposes in the clinica] 
manual of the Proverbs Test (10). 


Summary and Conclusions 
1. In a rigid Statistical test to determine 


its effectiveness for 
normal 


differentiating nor- 
mals from schizophrenics 


three intelligence groupings w 
quartile, middle 
e application of these cutting 


out approximately 


jects and 75% of schizo- 


Received April 3, 1956, 


References 
1. Arieti, S. Interpretation o, 
York: Brunner, 1955, 


Í Schizophrenia, New 
2. Baumgarten, F, A 


attitude m 
ment. Personnel Psychol., 1952, 5, meee 
3. Benjamin, J. D. A method for istinguishin 


and evaluating formal thinking 


Donald R. Gorham 


a n- 
schizophrenia. In J. S. Kasanin o 
guage and thought in schizophrenia. he 
ley: Univer. of California Press, 1944. 
65-90. jm- 
4. Bolles, M, & Goldstein, K. A study of OF ae 
Pairment of “absiract behavior 1938 12, 
Phrenic patients, Psychiat. Quart., i 
42-65. tors 
5. Cohen, J-A comparative analysis of the e o: 
underlying intelligence test paar ij 
different neuropsychiatric groups. Unp' 1950. 
doctor’s dissertation, New York Univer. 
Univer, Microfilms, 1950, No. 1923. the Air- 
6. Fruchter, B. The factorial content of pysonnel 
man Classification Battery. USAF, Pe 49-1. 
Train, Res. Cent., Res. Bull., 1949, oe the 
7. Goldstein, K, Methodological be area 
study of schizophrenic thought SA thought 
J. S. Kasanin (Ed.), Language ane Gaile 
in schizophrenia, Berkeley: Univer. 
fornia Press, 1944, Pp. 17-40. ial mental 
8. Goldstein, K. The significance of Spe schizo 
tests for diagnosis and prognosis "06 575- 
phrenia. Amer. J. Psychiat, 1939, 96, r 
588. nical an 
9. Gorham, D, R. A proverbs test for elin fonts? 
experimental use. Psychol. Rep. 
Suppl., 1956 No. 1. = 
Goh E R Proverbs Test. Gine 
Il and II], Best Answer Form. M ola 
cal Manual. Louisville, Ky.: Psy b 
Test Specialists, 1956. ial think 
11. Hanfmann, E., & Kasanin, J. CoE Monog" 
ing in schizophrenia. Nerv. ment. Dis. 
1942, No. 67. ag NE 
12. Hayakawa, S. I. Language in action. i 
Harcourt Brace, 1941. F. A. Mettle" 
13. King, W. R, Ability to abstract. In r ihe yrr j 
(Ed.), Selective partial ablation 0 its efet 
tal cortex: a correlative study iks = 
on human psychotic subjects. I- 
Hoeber, 1949. Pp. 218-238. a the inv 
14. Loeb, E. The function of proverbs on es. 56 
lectual development of primitive P & 
entific Mon., 1942, 74, 100-104. on, É in 
15. Meadow, A, Greenblatt, M., & pone t a 
“Looseness of association” and ye a mer 
abstraction in schizophrenia. J. 7 st 
Dis, 1953, 118, 27-35. verbs! T 
Cunders, C. J. A study of the mae conceP” 
as a measure of the abstract een Bay 
formation, Unpublished master’s 
lor Univer., 1956, 


L 

ms 7) 
Tor ink 
gical 


” york: 


16. P 


wr 


— +... 


Journal i 
Vol. 20, Wa gamiting Psychology 


The Ability of Schizophrenics to Modify Responses 
in an Interpersonal Situation’ 


M. David Diamond 
Riverside Hospital, The Bronx, New York 


A as present paper discusses the results of 
sis SA riment designed to test the hypothe- 
Schizoph schizophrenics, as compared to non- 
als, are rea emotionally disturbed individu- 
response eficient in the ability to modify their 
another S in the direction of the responses of 
Person. 

on defined rationality as the process 
tudes at the individual “can take the atti- 
Y these the others and control his action 
through ee and control their action 
tionay> is own” (2, p. 339). Thus the “ra- 
. the a eres can modify his responses in 
, ba of the responses of others. 

g similar lines of thought, Cameron 


Stat 
€s that, for the normal person: 


tuda $ more effectively he is able to allow the atti- 
mbes responses of others, which he predicts in 
the ee Tole-taking, to influence his own reactions, 
Te competent he ought to be in social situa- 


fe 
S (1, p. 93). 


Shee: 
shally _ the hypothesis tested was that 
Onses i enic individuals modify their re- 
of anothe in accordance with the responses 
Comm ler person when these responses are 
tha Unicated in an interpersonal situation 
ype”, Monschizophrenic individuals. This 
ness -/°SIS was tested at two levels of remote- 
an immediate stimulation by having 
Moth Jects respond, first in the presence of 
er individual, and subsequently alone. 
Mo iie Individual in an ambiguous situation 
re ice his responses in accordance with the 
2 Ses of another individual, when he is 
torah Mis Paper is a condensation of a part of a doc- 
D: a iain completed at New York Univer- 
a = 7 pas wishes to acknowledge the help of 
Nd p, ce D. Wechsler, M. Deutsch, I. Katz, 


in the presence of the other person, this 
would indicate that he can at least momen- 
tarily share the points of view of another per- 
son. If the individual modifies his responses 
in accordance with the responses of another 
individual, when the other individual is no 
longer physically present, this would indi- 
cate that his ability to accept the other per- 
son’s points of view is not merely a transi- 
tory one, and that he is able to internalize 
the points of view of another. As a rough 
analogy we might, from a psychoanalytic 
point of view, consider the first task to be a 
measure of ego controls and functioning and 
the second one of superego controls and 
functioning. 

Sherif’s work with the autokinetic phe- 
nomenon suggested a technique for demon- 
strating the degree to which one’s responses 
are modified by the responses of another, and 
the degree to which the responses of the other 
person are internalized. The autokinetic phe- 
nomenon consists of the perception of appar- 
ent movement of a stationary point of light, 
and is measured by having the subjects esti- 
mate the distance through which the point of 
light seems to move. Sherif found that when 
normal individuals are faced with the am- 
biguous autokinetic phenomenon, they form 
their own frame of reference and observe the 
point of light to move within a certain range. 
When individuals first face the autokinetic 
situation alone and then face it again in a 
group situation, they tend to change their 
estimates toward a norm and range which is 
established in the group. When subjects first 
face the autokinetic situation as members of 
a group, a norm and range are established 


which are peculiar to the group, and after- 
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wards when the subjects face the same situa- 
tion alone, they tend to adhere to the norm 
and range of the group. Sherif views the en- 
tire process as a prototype of the formation 
of a social norm, which then acts asa frame 
of reference for determining later reactions 
os autokinetic phenomenon seemed to be 
particularly appropriate for studying the ef- 
fect of social interaction on behavior because 
it enables the investigator to isolate the vari- 
able of social influence from complex field in- 
fluences such as the effects of learning and 
experience. Thus, in the Present study an 
autokinetic experiment Was used as a meas- 
ure of the degree to which subjects modified 


their responses in the direction of the Tre- 
sponses of others. 


Subjects 

The experimental 
pitalized male schiz 
schizophrenic subjec 
as schizophrenic r 


subjects were thirty hos- 
ophrenics. Of the thirty 
ts ten had been classified 
eaction, paranoid type; 

i childhood 


s schizophrenic 
ated type, 

was sought which mani- 
fested a variety of types of Psychopathol- 
ogy in order to elimi i 


habilitation hospital 
subjects since, as a 
found to present a v 
turbances. No schiz 


Table 1 


Nonparametric Median Te 


st for Initial Difference 
Between Pair-Member: ià 


s’ Estimates of Light 


Movement When Judging Alone 
Below Above 
Subjects median median Total 
Schizophrenic pairs 7 8 is 
Drug addict pairs’ 8 7 15 
Total 15 15 
Chi square = .13 df=1 p> 10 
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Table 2 


z etween 
Nonparametric Median Test for a Ee 
Pair-Members’ Estimates of Light Move 
When Judging Together 


Below Above 


: Total 
Subjects median median n 
Schizophrenic pairs 4.5 nn 15 
Drug addict pairs 10.5 2 
Total 15 S 
Š .02 
Chi square = 4.8 dj=i p< 


icts, 
were selected. Of the thirty drug a 
eight were classified as inadequate Tie ga 
ality, eight as schizoid personality; ne was 
passive-aggressive personality; m cate- 
classified in each of the following dolescence: 
gories: adjustment reaction of adolesce! 


4 mix 
adjustment reaction of SE, EA 
Psychoneurosis, neurotic character lity 


-sona 

Personality pattern disturbance, Pers +i0D, 
trait disturbance, psychoneurotic 
and sociopathic personality. ted to be 

The control subjects were selec espect t° 
similar to the schizophrenics with d intelli 
age, highest school grade complete egu d 
gence, race and socioeconomic e a 
The mean ages of the a 18.5; 7 
drug addict groups were 19.3 yor grade 
spectively; the mean highest “ively; e 
completed, 9.6 and 9.9, evi tl “| 
mean IQs 94.1 and 98.8, vespes antly al 
two groups did not differ signif acteristiot 
respect to any of these three aa per = 
Both groups consisted of about h of PU 
Caucasian, and 25 per cent eac jmari 
Rican and Negro individuals, p" 
Ower socioeconomic background. 


Procedure 


ta acco” a 
The modification of responses T neat 
ance with the responses of others xperi Gi 
ured by means of an autokinetic € ap! ae 
in which the subject judged the point e 
amount of movement of a sanon t a i ony 
light in a darkened room, first ee nee 
wen, With another individual, and the? , Oir 
alone again. Each subject made sf these "0 
mates when alone. On the basis 0 $ 


sect 
: : z u 
tial estimates when judging alone, § 


> 


a J 


Ability of Schizophrenics to Modify Responses 


ach group were then assigned to pairs so 
that the initial differences between pair-mem- 
bers’ estimates were approximately the same 
for subjects in both groups. The subject then 
Made twenty judgments when with his pair- 
Member and finally twenty more judgments 
When alone again. 

The relative amount of convergence of 
Pair-members’ estimates when judging to- 
gether provides a measure of the degree of 
modification of responses when in an inter- 
Personal situation. The relative amount of 
Convergence of estimates of pair-members 
When later judging alone provides a measure 
of the degree to which the “group norm” was 
Mtrojected or internalized. 

For each of the three parts of the experi- 
Ment—individual judgments, judgments in 
Pairs and subsequent individual judgments— 

© median of the twenty estimates was de- 
ermined for each subject. The difference be- 
tween the medians of pair-members’ esti- 
Mates for subjects in the two groups was 

en compared by means of the nonpara- 

etric median test for each part of the ex- 
Periment. The nonparametric median test 1s 
“ssentially a chi-square test. 


Results 


Table 1 presents the results of the non- 
Parametric median test which tests the hy- 
Pothesis that the initial difference between 
Pair-members is the same for the two groups. 
ig. Tesulting chi-square value of 0.13, which 
iit Statistically significant, supports the 
t hypothesis that the two groups come 
di populations having the same median 

Erence between pair members with respect 

their assignment to pairs. Thus the pairs 
Wi the two groups can be considered similar 

sa tespect to initial differences between the 
€dians of their estimates, before the experi- 
ental variable was introduced. 
hen judging with the pair members, sub- 
ects in both groups modified their responses 
H accordance with those of the pair members. 
Owever, the modifications made by the drug 
dicts were greater than those made by the 
“hizophrenics. 
able 2 presents the results of the median 
est for the differences between median esti- 
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mates of pair members when judging together. 
The obtained chi-square value of 4:8 is sig- 
nificant at the .02 level. Thus, the data sup- 
port the hypothesis that schizophrenic indi- 
viduals modify their responses in accordance 
with the responses of another person less than 
do nonschizophrenic drug addicts, when re- 
sponding in the presence of the other person. 

The results obtained with the drug addicts 
are similar to those obtained by Sherif when 
he performed an autokinetic experiment with 
pairs of normal subjects. When responding in 
a group after having first responded alone, 
the median difference between Sherif’s pair- 
members’ estimates was about 0.50 of an 
inch, which is the value obtained for the drug 
addict pairs (3). 

When responding alone after having judged 
with the pair member, the drug addicts con- 
tinued to modify their responses in accord- 
ance with those of the pair member as much 
as when they were in the presence of the pair 
member. The schizophrenics, on the other 
hand, tended to deviate more from their pair- 
members’ estimates when no longer in the im- 
mediate presence of the pair member. 

Table 3 presents the results of the non- 
parametric median test for the median differ- 
ence between pair-members’ estimates when 
judging alone after judging in pairs. The ob- 
tained chi-square value of 6.5, which is sig- 
nificant at the .01 level, supports the hy- 
pothesis that, after having participated in an 
actual interaction with another person, schizo- 
individuals modify their responses 
th the responses of the 
chizophrenic drug 


phrenic ] 
less in accordance wi 
other person than do nons 
addicts. 
Table 3 
i i x ifferences Between 
ametric Median Test for Diti 
Se ip teeter? Estimates of Light Move- 


ment When Judging Alone After 
Judging Together 


Below Above 
Subjects median median Total 
Schizophrenic pairs 4 11 15 
Drug addict pairs 11 4 15 
Total 15 15 
Chi square = 6.5 df=1 p< 01 
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In this part of the experiment, also, the 
drug addict pairs resemble Sherif’s normal 
pairs (3), in that the median difference be- 
tween pair-members’ estimates when judging 
alone after judging together was about 0.50 
of an inch for both Sherif’s group and the 
drug-addict group. 


Discussion of Results 


The results support the hypothesis that 
schizophrenic individuals modify their re- 
sponses less in accordance with the responses 
of another person, when these responses are 
communicated in an interpersonal situation, 
than do nonschizophrenic individuals. 

The subject’s estimates 


» from a psychoanalytic point of 
view, to reflect the adequ 


the personality that is large} 
d 
through a continuous p he 


these results Suggest that, 


M. David Diamond 


ee Jso 
phrenic, not only ego functioning, but also , 
superego functioning is affected. 


Summary 


A variation of the autokinetic exp' fe E 
was employed to test the hypotes a 
as compared to nonschizophrenic emo e de- 
disturbed individuals, schizophrenics pete 
ficient in the ability to modify their res ae 
in the direction of the responses mek 
person. Thirty hospitalized male ome the 
ics and thirty male drug addicts Judg | 

' 


‘on 
apparent amount of movement of a a 
ary point of light in a darkened “dividual 
when alone, then with another again. 
from his group, and then when n When | 
The results supported the ape 

estimating light movement in the eine schizo” 
another person, the convergence of ee tha 
Phrenic pairs was significantly less ict pails 
of the nonschizophrenic drug-addie og A 
When responding alone, after Se perso”: 
sponded in the presence of the sihen irs 
the convergence of the schiz opiten of the 
again was significantly less than t 

nonschizophrenic drug addict pairs. 


—y 
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Concept Learning in the Educationally Retarded 
Child of Normal Intelligence 


Nissim M. Levy and Joseph M. Cuddy 


Brown University 


The report presented here is part of a 
larger project concerned with the develop- 
ment of a technique for predicting which chil- 
dren of normal intelligence, as measured by 
the usual methods, are likely to develop learn- 
Ing difficulties. The commonly-used measures 
în this area are estimates of intelligence, read- 
Mg readiness, and social and physical devel- 
opment. Unfortunately these measures, except 
When they are fairly low, are relatively poor 
Predictors, 

Since most of the important tasks that chil- 

ten must master in school involve learning, 
a good instrument for estimating rate of 
learning may be of considerable value for 
€valuation purposes. This approach to the 
Problem may be especially fruitful since rate 
Ol learning is very likely a complex function 
of not only intelligence, but also strength of 
Motivation to learn, and reactions to failures 
uring the acquisition process. 

A careful examination of typical intelli- 
Sence tests leads one to the fact that most 
of the material depends heavily upon the 
achievements of the individual. Of the WISC 
Subtests, for example, none of them with the 
Possible exception of the coding allow the sub- 
a an opportunity to improve performance 
during the assessment situation. This behav- 
tor sample is probably too small to be ade- 
ately used as a learning measure. However, 

is interesting to note that Altus (1) re- 
Ported consistently low scores on this subtest 
in records of 24 severe cases of educational 
retardation, 
th The present study was designed to answer 

€ following question: Given a group of chil- 
Ten of normal intelligence some of whom are 
Underachievers in school, do underachievers 


differ significantly from normal achievers in 
ability to solve a concept-formation problem? 
A concept-formation problem was chosen for 
the first investigation on the assumption that 
it might provide the most sensitive measure 
of impairment in learning attributable to mo- 
tivational and emotional difficulties. 


Method and Procedure 


The Ss were 23 pairs of fourth-grade ele- 
mentary school children matched for age, sex, 
and, roughly, for socioeconomic status of par- 
ents. The Ss’ IQs ranged from 98 to 103 as 
measured by the California Test of Mental 
Maturity. One student of each pair was work- 
ing up to grade placement while the other 
was behind from .5 to 2.5 years in achieve- 
ment as measured by the Stanford Achieve- 
ment Battery. 

The learning task used for the study was a 
variation of the Oddity problem. Ten sets of 
Vigotsky Blocks were used. Each set con- 
sisted of three wooden blocks. In each set, 
the correct block was the odd one in terms of 
one of three possible dimensions. The three 
dimensions used were size, color, and shape. 

Each S was told that his problem was to 
find out how to tell which was the correct 
block each time he was presented with a dif- 
ferent set. If S chose the correct block, he re- 
ceived a chip. If he chose an incorrect block, 
E said, “That’s not right,” and the set of 
blocks was removed and another set pre- 
sented. At the end of the game he received 
a penny for each five chips he had won. 


1The authors wish to thank Dr. James Hanley, 
Superintendent of the Providence City Schools, and 
Miss Mary Lauth for their cooperation and assist- 
ance in making this study possible. 
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Five blocks of ten trials were given to each 
S, each block consisting of a random order of 
the ten different sets. If S chose correctly on 
11 consecutive trials, testing was discontinued 
and S was credited with correct choices for 
the balance of the 50 trials. Testing was con- 
tinued even when S spontaneously verbalized 
the correct principle before the end of the 50 
trials. At the end, all Ss were asked to ver- 
balize how they solved the problem. 

The measures of learning used were: (a) 
number of errors; (6) number of trials to cri- 
terion; and (c) verbalization of the Oddity 


principle. 
Results 


Errors. In 18 out of the 2 
the study, 


ts. This result 
Oi, 


All 10 of these 
ain this result is 


yields a p value of less than 
Ten Ss met both criteria. 
Ss were normal achievers, Ag 


Table 1 


Median Test for Discrepancy S 
y Score: 
Matched Subjects 


Medi 
sos Above oS 
Condition median below 
Normal achiever reached criterion ; 
underachiever did not, 10 3 
Neither S reached criterion, 9 8 


Exact p value, .012 
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significant at well below the .01 level of con- 
fidence. 

Using either criterion, 13 of the 23 pairs of 
Ss had a difference in favor of the normal 
achiever, while no difference occurred in 10 
pairs. Inspection of the data suggested the 
Presence of a relationship between degree of 
discrepancy in achievement between the nor 
mal achiever and the underachiever of a given 
pair, and the likelihood of a difference occut- 
ring in either criterion in favor of the nor- 
mal achiever. Therefore the difference score 
in achievement level for all of the pairs of 5s 
was calculated. The over-all median of the 23 
discrepancy scores was calculated and the 
data analyzed by means of the nonparametrie 
median test. The contingency table anene 
irom. this analysis is presented in Table if- 
Fisher’s exact method for testing the eed 
cance of contingency tables with small n é 
quencies was used and resulted in a $ yi a 
of .01, confirming the suggestion of a aed 
tionship between the degree of underachiev" 
ment and the likelihood of a difference 
favor of the normal achiever. iled 

It should be pointed out that icin ce 
lests are conservative estimates of significan 
in this study since the implicit hyp m 
being tested calls for a prediction of a om 
rectional difference. We would predict n 
both an empirical and theoretical basis 
the underachievers would do less well. 


Discussion 


ft 
The results of the study are quite i 
“very measure of learning used demonst# e- 
a significant difference in performance airs 
tween our two groups. The finding that Pore 
of Ss with higher discrepancy scores eas 
Often yielded a difference in criterion s ghat 
ures is further support for the hypothes!s 
underachievers learn more slowly. ithe! 
Since 29 of the 46 Ss failed to meet a 50 
Criterion it js quite likely that the limit yer 
trials was too low. An examination of thé the 
alization of the Ss who did not 5° seh er? 
Problem indicated that many of he “en 
at least on the way toward solution: jem 
asked how they tried to solve the P!°” py 
Some of them indicated partial solutio 


Ra 
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Suggesting that it was the smaller one or 
larger one or the one that was a different 
shape. The Ss were credited with the correct 
solution only if they indicated all three di- 
mensions or simply said that the correct block 
Was always different from the other two. 

A difference in the rate of learning of a 
concept has been demonstrated in this study. 

he question arises as to whether this differ- 
ence is restricted to the conceptual area or 
Whether it may be a more generalized deficit. 
n an attempt to answer this question the 
Same children are being used as Ss in a num- 
ber of other types of learning problems such 
as pursuit-rotor, stylus maze, paired associ- 
ates, mirror drawing, discrimination, and 
Problem boxes. 

Whether we find underachievers demon- 
Strating a general deficit in learning rate or 
Whether it turns out to be primarily related 
to the verbal or conceptual areas the question 
Will still remain whether or not we can de- 
tect these potential underachievers in pre- 
School or the first grade. 

Much of the thinking of clinicians con- 
cerned with the problem of the underachiever 
Suggests that in many cases the familial in- 
terpersonal constellation and early history of 

€ child play a considerable role in develop- 
Ment of this condition. It would be reason- 
able to assume then that these children have, 

Y the time they reach school age, already 
developed those patterns of behavior which 
Will result in underachievement. This sug- 
Bests that we can hope to find a learning-rate 

ference in children of normal intelligence 

Y the time they reach school age which may 

© Predictive of later underachievement in 
Choo], 

s Tt must be emphasized that what we are 

USgesting is not the use of learning tasks as 

Substitute for the standard intelligence 
Yeales. Hodges (4) following a lead of Hunt’s 
5 reported a study in which he estinated 

ental age from a variety of measures of 
Performance in a double-alternation a 
va © Correlations which Hodges eg 

tied between .22 and .74. It should be 

“a from his results that these two tech- 


U . 
Wes are different. 


Binet, it will be recalled. defined intelli 
gence as the ability to profit from experience 
Most intelligence tests use the same assump: 
tion that Binet used in order to justify them: 
selves. This assumption is that all subjects 
measured by the particular instrument had 
the same opportunity for the experiences 
which are relevant to the material being used 
as the instrument. That this assumption is a 
weak one has adequately been pointed out 
before (2, 3). In part it is the weakness of 
this assumption which makes the use of such 
tests relatively inadequate for the prediction 
of academic success. Perhaps if Binet had 
worked on his problem after Thorndike, the 
tests which he would have developed might 
have been more along the lines of the work 
we are suggesting. 


Summary 


Twenty-three pairs of fourth-grade children 
matched for age, sex, and very roughly for 
socioeconomic status served as Ss in a con- 
cept-learning task. The Ss’ IQs ranged from 
98 to 103 as measured by the California Test 
of Mental Maturity. One S of each pair was 
working up to grade placement while the other 
was behind from .5 to 2.5 years in achieve- 
ment as measured by the Stanford Achieve- 

ttery. All Ss were given a maximum 
rte ai within which to reach the criterion 
of 11 consecutively-correct choices. A varia- 
tion of the “Oddity” problem was used. At 
the end of testing, all Ss were asked to ver- 
balize how they attempted to solve the prob- 
lem. The measures of learning were: (a) num- 
ber of errors; (b) number of trials to cri- 
terion; and (c) correct verbalization of the 

i rinciple. 

Ey ott af 23 pairs of Ss, the normal 
achiever made fewer errors than his matched 
underachiever. Eleven Ss reached the cri- 
terion of 11 consecutively correct choices. Six- 
teen Ss correctly verbalized the principle. 
Fourteen were normal achievers while only 
two were underachievers. Ten Ss met both 
criteria and all 10 of these Ss were normal 
achievers. Ail of these results were statis- 
tically significant ‘below the .01 level of con- 


fidence. 
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Implications of these results were discussed 
and the direction of further needed research 
was suggested. 


Received July 26, 1956. 
Early Publication. 
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The TAT and Antisocial Behavior 
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of disequilibrium between an impulse system 
and a control system, the latter involving as- 
Sessments of reality consequences as well as 
internalized standards serving as restrictions 
Pili behavior. The present study is designed 
examine certain disturbances of the im- 
in ge control balance as they are manifested 
th AT productions. Lindzey has referred to 
ak determination of the conditions under 
tear inferences based on the projective ma- 
the; directly relate to overt behavior and 
Sne conditions for the reverse” (2, p. 18) as 
the n the major interpretive problems for 
ef AT. Studies examining the relationship 

| viene fantasy and overt behavior have 
(5 ed varied results (5, 9). Neither Murray 
a hor Sanford et al. (9) found any sub- 
Pos fal direct relationship between the in- 

e Sity of fantasy aggression and its overt 
oe Sion. However, in explaining their re- 
Pective results, each hypothesizes a factor of 
l oy tural prohibition serving to prevent the 
€rt gratification of antisocial needs. In or- 
mid to circumvent the complicating factor of 
e dle-class inhibitions regarding aggressive 
nig Mussen and Naylor (6) studied a 
sy Up of lower-class boys whose culture pre- 
Mably encourages rather than inhibits overt 
a ession, They found strong support for a 
Siy, itive relationship between fantasy aggres- 
© needs and overt aggressive behavior. 

ti 2 over, they found suggestive evidence that 
to Mount of punishment anticipated relative 
aggressive needs was an important deter- 


| 
| Antisocial behavior may be viewed in terms 
z 
4 
é 


1 
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4 se ie Besnia, Carl Eisdorfer, Marvin Greenstein, 
olleet Kouguell, and Dr. Philip Kubzansky who 
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minant of overt aggression. With the excep- 
tion of Mussen and Naylor’s work, previous 
investigations attempting to correlate covert 
needs and overt behavior have tended to neg- 
lect the role of inhibiting or defensive forces 
in modifying the behavioral resultant of covert 
needs. Mussen and Naylor, however, made no 
effort to distinguish between external and in- 
ternal controlling forces. 


Hypotheses 


The major hypotheses of the present study 
may be stated with reference to different 
facets of the impulse-control balance: 


A. Impulse System 

1. There is a direct relationship between 
degree of aggressive, antisocial behavior, and 
the number of aggressive thoughts manifested 


D 


in TAT stories. 
2. The form as well as the number of TAT 


aggressions is related to the extent of overt 
aggressive behavior. More aggressive indi- 
viduals are likely to express TAT aggressions 
crudely and directly, relatively unhampered 
by repressive processes. 


B. External Control System 


3. Overt antisocial behavior varies inversely 
with the anticipated amount of fantasy pun- 


ishment from an external source. 
4. Among antisocial individuals themes of 


external punishment are more likely to serve 
as justifications for aggression than among 
nonantisocial individuals. This hypothesis is 
derived from Redl and Wineman’s (8) de- 
tailed account, of the “delinquent ego.” By 
this is meant the ego whose every effort is 
bent toward obtaining guilt-free and anxiety- 
free enjoyment of delinquent impulsivity. 
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C. Internal Control System 


5. Overt antisocial behavior varies inversely 
with the anticipated amount of fantasy pun- 
ishment from an internal source. 

6. Of the two types of punishment, internal 
and external, anticipated internal punishment 


is the more significant inhibitor of antisocial 
behavior. 


Method 


Fifty-seven male Army trainees between the 
ages of 17 and 26 with a mean age of 20 were 
used as subjects (Ss) for this experiment. All 
were psychiatric referrals to the Mental Hy- 
giene Clinic for whom Psychological testing 
was requested. The only patients excluded 
were those suffering from organic brain dam- 
age or those diagnosed as psychotic. 

Each S was seen individually by one of 
three clinical Psychology specialists who ad- 
ministered cards 1, 3BM, 4, 6BM, 7BM, 


14, and 18BM of the 
al Psychology specialist 
er of whom had adminis- 
Ts, independently scored 


criminal 
running away, re- 
c lying, cheating, 
Someone, rejecting 
h, illness, or acci- 
ects in a story was 
n. Since the present 
xtrapunitive aggres- 


assault, getting angry, criticizing, 
sisting coercion, being negativisti 
stealing, dominating or restraining 
someone. The occurrence of deat 
dent to parents or other loved obj 
also regarded as fantasy aggressio, 
study is concerned only with e 
sion, such items as suicide, self-injury, and self-de. 
preciation were not scored as fantasy aggression. The 
Pearson 7, used as the reliability measure in every 
case, showed the correlation between independent 
scorings to be .91. 


An external punishment score 
summing the frequency of such themes as the fol- 
lowing when they were directed toward the hero: 
assault, injury, threat, quarreling, deprivation of some 
privilege, object or comfort, domination, Physical 
handicap such as blindness, etc., rejection, Scoring 
reliability was .81. 


was obtained by 


Kenneth Purcell 


Internally based punishment included e 
depreciation, and feelings of guilt, shame, or T! oases 
Since a broad definition of punishment ba na Sa 
“injury to a loved object,” instances gF deat ai 
ness, or accident to parents or other he Ae 
were recorded in this category of internal P Te 
ment. In instances in which the hero of the story © 


5 striking 
the direct agent of aggression, eg. bebe i except 
his wife, internal punishment was not sc! rae, 08 


where there was a clear expression of a 7 
shame. By contrast, accidental injury, death, of in- 
ness of a loved one always received a a denied 
ternal punishment unless the hero specifica reliability 
anything resembling guilt feelings. Scoring 
was .89, t be- 
Remoteness of fantasy aggression from h one 
havior was rated on a seven-point scale 2 expres- 
representing the most direct form of fantan punted 
sion. For each instance of fantasy PEREI made- 
in the TAT story, a remoteness rating Sia when 
The following considerations were kept in ssion (PO 
evaluating remoteness: (a) object of aggre p), time 
Son, society, animal, inanimate object), <A 
| 


— N 


(present, past, future), (c) place taisoma ehavio": 
other countries, other planets), (d) leve: ecial states 
wish, memory, daydream, nightdream, P eesociatio™ 
of consciousness such as intoxication, text and tis 
drug addiction, insanity), (e) social oor perl a 
stigator (hero instigates aggression, directly 
along with crowd, or even has nothing due t0 oF f 
do with aggression, e.g. death of someone number A | 
ease or accident). The reliability for me pe Pi 
one and two remoteness ratings score 
96. 1 be 
socia 
Measurement of aggressive ao dat 
havior was based on the social are s a 
routinely obtained by the psychia include 
work specialists. Such informatio” cies: Cam 
a record of S’s military eet e | 
AWOL, refusal to obey orders, a jvil be 
as well as S’s report of any acer ster 
behavior, e.g., truancies, gang fe ilitaY A | 
ing, peddling of drugs, etc. The rifia ep 
formation was, of course, easily Ve activ! 
the data pertaining to premilitary’ ; whi 
Were not, except in certain instet eai jes 
records were requested from refor sev’ 
other institutions mentioned By el 10 ei 
factors, however, indirectly poe 
Substantial accuracy of Ss’ acco A an? pl 
Civilian behavior. First, the civilian?“ griaP i, 
tary behavior data were almost en 
consistent with respect to aay tant w 
teristics. Nevertheless, it was 1 Jong at 


use the premilitary history to get # ive po 


. er ess} 
Picture of S’s characteristic ag8" 


. gyidu 
tern, particularly for those indivi 
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time in the military was relatively brief. Sec- 
ond, a subsequent check of psychiatric diag- 
nosis revealed no case in which there was 
gross discrepancy between the clinical impres- 
ston of the psychiatrist and S’s report of his 
aggressive behavior pattern. Third, on every 
occasion in which independent confirmation 
of Civilian behavior was available (15 cases), 
S's own account was corroborated. 

Data pertinent to the variable of aggressive 
behavior were extracted from each S’s social 
history by the three clinical psychology spe- 
Cialists who had been responsible for testing. 
The author and one of these specialists rated 
the behavior extracts for aggressivity on a 


- S€ven-point scale with one representing the 


least degree of aggressive behavior. The pos- 
sibility of knowledge of test scores influenc- 
ing behavior ratings or vice versa was negli- 
Sible for two reasons. First, the specialist who 
Served as a judge to check the reliability of 
the behavior ratings had administered only 
25 per cent of the total number of TATs, and 
Second, the behavior ratings were accom- 
Plished two months prior to the TAT scor- 
Mg. Sample extracts of the extremes of the 


/ Scale are presented below. 


Rating of 1: Steady school attendance record 


through fifth term high school. After leaving school 


Worked his way up to level of assistant pressman in 


_ Print shop at $110 per week. He was drafted from 


firm which had employed him since 1948. Married 
eo living with wife and child for three years. No 
Mitary or civilian delinquencies reported. 7 
Rating of 7: Long history of truancies, delin- 
Mency and classroom misbehavior. In reform school 
ce Years. Prior to induction was confined us 
he eight months for armed robbery. While aves 
Reger in possession of drugs and jailed one month. 
‘aulted several people. Enlisted in Army on advice 
Parole officer to get reduction of sentence. History 
eight AWOLs and four courts martial. Now fac- 
a general court martial, five years in prison, and 
aqp Shonorable discharge because he wrecked stock- 
Pensary, 


of 
in 


The reliability of these behavior ratings 
a 91. In order to assure large enough 
Oups for comparison the seven-point scale 
"as then consolidated into a three-point scale, 
mining ratings of one and two; three, four 
five; and six and seven. Hereafter, Group 
i 24 Ss refers to the least antisocial group, 
OUP IT of 19 Ss to the intermediate, and 
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Table 1 


Product-Moment Intercorrelation of TAT Variables 


Ext. Pun. 
FA 


Remoteness Int. Pun. 
FA FA 


FA 


Remoteness 
FA 


Int. Pun. 
FA 


Ext. Pun. 
FA 


—.13 


Int. Pun. 


Ext. Pun. 09 


89 .01 


* An r of .36 is required for significance at the 1% level, 


Group III of 14 Ss to the most antisocial 
group. 
Results 


Since the interpretation of results depends 
in some degree upon the relative independence 
of the five TAT variables their intercorrela- 
tions are presented in Table 1. Most of the 
relationships are statistically significant as 
seems logically required by the fact that com- 
plementary aspects of the impulse-control fac- 
tor of personality are represented. However, 
in nearly all instances, the amount of vari- 
ance in one variable that can be accounted 
for by the variance in another (as measured 
by 72) is very low to moderate. Therefore, 
each of the variables may be said to con- 
tribute some unique information beyond their 
common meaning. 

As shown in Table 2 the analysis of vari- 
ance indicates over-all significant differences 
between the means of the three groups. This 
does not tell us, however, how well the three 
groups are separated. Therefore, before de- 
scribing these results in detail, more precise 
information on the differences between the 
groups is presented in Table 3. Two-tailed 
tests of significance were used. It is apparent 
that in nearly all instances each group is sig- 
nificantly different from the other two. 

The difference between the means of the 
three groups in number of fantasy aggression 
themes, as shown in Block A of Table 2, is 
highly significant beyond the value of p = 
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Table 2 


Analysis of Variance for Three Groups Differing in Degree of Antisocial Behavior 


-e 7 $ 
TAT Variables Mean Variance* F 
A. Fantasy Aggression . 5 .001 
Group I 6.08 Between Groups 136.69 23.98 
Group IT 8.05 Within Groups 5.70 
Group III 11.64 
B. Number of 1 and 2 
Remoteness Ratings 
Fantasy Aggression ss 001 
Group I 10 Between Groups 71 35.5 
Group IT 17 Within Groups -02 
Group TIT -49 
C. External Punishment 
Fantasy Aggression 5 
6 0 
Group I .87 Between Groups Re 3.66 
Group IT -70 Within Groups 09 
Group IIT -62 
D. Internal Punishment 
Fantasy Aggression 001 
Group I 719 Between Groups 2.88 20.57 i 
Group II 32 Within Groups ld 
Group III -08 
E. Internal Punishment 
External Punishment 001 
Group I 1.03 Between Groups 3.63 12.96 
Group II 52 Within Groups 28 
Group Ul 15 


Wer-Class back- 


ocial groy 
predominantly middle class (x? eter a 
5% level). 

To press the examination f 
Groups I and III (least and most antisocial) 
were then separated according to social class. 
Using the ų statistic described by Lora (3), 
the significance of the difference in number of 
aggressions for middle-class Ss only was cal- 
culated. The same was then done for lower- 
class members of Groups I and III. 
III Ss produced significantly more agg 
themes than Group I Ss regardless of 


urther, the Ss in 


Group 
ressive 
social 


n 
class. Although the number of Ss © 


Jati 
A e re 
these comparisons are based ar 


n 
few (15 middle-class Ss in Group Hie 
Group III, 6 lower-class Ss in wee 
in Group III), the p values were - validity, ip 

hese several findings confirm the elati nsh f: 
Hypothesis 1 which concerns the ™ ebavi e 
between aggression in fantasy a io o ae 

To evaluate Hypothesis 2 the sh ie oe 
and two remoteness ratings to tO h 
aggression score was compared ae 
8rouns. The results, shown in betwee” oot. 
Table 1, reveal the difference a: 


Spond with more aggressive menn w 
quality of his fantasy aggression rie 
direct and undisguised than is 
nonantisocial individual. 


> 
en 

2 a 
ose 
SB 
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Block C of Table 1 compares the ratio of 
eae a 
7 groups. The significance of the 
difference between the means attains a value 
of p = .05. Thus an important force inhibit- 
Ing the nonantisocial group appears to involve 
Some sort of anticipated punitive action from 
without, giving support to Hypothesis 3. 
Hypothesis 4 calls for a closer look at the 
fantasied external punishments. These were 
Separated into three categories according to 
the following principles: (a) external punish- 
Ment occurring subsequent to fantasy aggres- 
Sion and as a direct consequence of such 
jeetession, e.g., “he was sent to jail for steal- 
ios ; (6) external punishment occurring prior 
tio antasy aggression and used as a justifica- 
to hl such aggression, e.g., “she was mean 
im so he hit her”; (c) external punish- 
Sg having neither of the above relationships 
0 fantasy aggression, e.g., “she held him 
ack because she was afraid he might get 
hata The total number of external punish- 
rc is larger for Group III than Group I 
Ż = .05. It is clear, however, that TAT 
€mes of external punishment are far more 
Tequently utilized as excuses for aggression 
Y antisocial members of Group III (p= 
01), thus confirming Hypothesis 4. The 
Mean number of themes classified in this 
Manner was 3.64 for Group III, 1.25 for 
toup I. External punishment themes as a 
Heth consequence of aggression are also more 
yamon among Group III Ss although the ¢ 
alue of 1.89 falls just short of significance. 
ince the number of postaggression punish- 
h ent themes is obviously dependent upon the 
Umber of fantasy aggressions, an attempt 
the made to compare retaliatory punishment 
sh Mes on a proportional basis. The data 
D Owed that the mean ratio of retaliatory 
‘"nishment themes to fantasy aggression Is 
Sntical for Groups I and III so that it was 
Even necessary to calculate a significance 
etic, Interestingly enough, the number of 
tac Mal punishment themes unrelated to fan- 
Baggy oe ession is larger among the nonanti- 
BI members of Group I (p = 01). ai 
fere ock D of Table 1 indicates that the dif- 
gees between the group means, with re- 


; i to the quantity of guilt and shame 


e AARO R 
Mes proportional to aggression, is signifi 


Table 3 


t Ratios of Group Differences * 


5 &| 5 Ele Ble EJS 
S 23/2 2/8 2/8 sls 
Groups f Tale § & Ele ‘ale 
compared s o Hi 7 RJS 29 ZJB 
> BSl> ala al> sle 
Esle Sle Sle sls 
& Zale Sle Sle SIX 
Group I 
vs. 3.18 175 1.77 3 2.83 
Group II ss e3 
Group II 
vs. 4.17 533 1.09 6.00 7 
Group III f N 
Group I 
vs. 6.04 7.84 2.27 444 4.40 
Group III 


a 


* Minimum # ratios required for signific: : aa 
2,04 = <.05, 2.75 = <. ance: 1.69 <.10, 


<.01, 3.64 = <.001. 
cant at the value ~=.001. Since the anti- 
social Ss produced significantly more aggres- 
sive themes than the nonantisocial Ss, one 
may wonder whether this alone is not the 
crucial determinant in creating differential 
values of the ratio of internal punishment to 
fantasy aggression. If one were able to find 
individuals in Groups I and III with aggres- 
sive impulses of similar strength, then the 
effect of internal punishment expectations 
could be independently evaluated. Overlap- 
ping in the number of fantasy aggressions 
between Ss of Groups I and III permitted 
comparison of six members from each group. 
They were the six highest and lowest in 
Groups I and III respectively in number of 
fantasy aggression themes. The w statistic 
shows no significant difference between the 
two groups with respect to fantasy aggres- 
sion. However, the proportion of internal pun- 
ishment to fantasy aggression is much larger 
for the nonantisocial group (p = .001). The 
mean ratio was .11 for the six Group HI 
members and .54 for the six Group I mem- 
bers. 

The relationship between socioeconomic class 
and antisocial rating raises a similar question 
regarding internal inhibition as was posed for 
fantasy aggression. Does the difference in 
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number of internal punishment themes for 
antisocial and nonantisocial groups hold true 
irrespective of social class membership? The 
u statistic shows clearly that Group I Ss pro- 
duce significantly more internal punishment 
themes than Group III Ss regardless of social 
class. The difference between the middle-class 
members of Groups I and III is significant 
beyond the .001 level and among lower-class 
members of the two groups the difference 
achieves significance at the .01 level. 

As shown in Block E of Table 1, the ratio 
of internal to external punishment themes 
differs significantly for the three groups (p 
= .001). The much higher ratio for Group I 
Ss suggests that internal punishment antici- 
pations are a more potent deterrent to anti- 
social behavior than are external punishment 
anticipations, supporting Hypothesis 6, 


Discriminative Power 


Since a widely used diagnostic instrument 
was employed in this study it was deemed 
desirable to obtain some measure of diagnos- 
tic power or forecasting efficiency as distin- 
guished from statistical significance. In order 
to evaluate discriminative Power accurately 
it is necessary to make three comparisons of 
overlapping scores: Group I with Group II, 


Table 4 


Discriminative Power of Indicato 
from the TAT * 


ee 


rs Obtained 


Groups I 
Variable & I “ee Eo 3 

Fantasy Aggression 68 67 T6 
Number of 1 & 2 

Remoteness Scores 

Fantasy Ageression 58 82 

Fantasy Aggression 90 
External Punishment 6 

Fantasy Aggression 58 66 
Internal Punishment 

Fantasy Aggression a 88 97 
Internal Punishment r 
— 70 
External Punishment 82 92 


* Numbers in table refer to 


eum percentage of cases correctly 
classi: A 
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Group II with Group IH, and Group I with 
Group III. In each instance the median a 
overlapping scores of the two populations b e 
ing compared was selected as the cutoff point- 
Thus there were three different cutoff pon 
for three separate comparisons. The pere 
age of correct classifications is calculate 
from the number of cases in each eae 
comparison falling on the predicted se T 
the overlap median score. The data - Te rj- 
4 suggest that the most discriminating in 
ables are the two internal punishment ~ 
In clinical practice, however, it would pee 
appropriate to approach this cassida jia 
problem by judging the agen 
among the factors. For example, one © ag- 
members of Group I had a high eg? 
gression score but fell well within hos cate- 
antisocial group in all other scoring 
gories. 


Discussion 
Since the finding of a positive T 
between fantasy and aggressive beh 
true for Ss of the middle as well sal eñi 
class some attempt at explanation 5€ 


elationshiP 

avior 

the lowe? 

g War- 
San- 

of PF 

ranted in view of the contrary jest E p m 

ford et al. (9) and Murray (5)- 1 Ss in 

severity of aggressive behavior ot an 

the present study seems far greater and 


: : jes f i 
true for either of the previous S iscri 


this, of course, made for an eaS E jm 
nation. Furthermore, it is the aI and 
Pression, also suggested by Re who 


Feshbach (1), that certain individue eae 
characteristically behave in impuls! an W 
Social fashion not only find fantaa 
satisfactory substitute for direct ae d to 
may actually be stimulated and Prov". osti? 
act out by a succession of onrushini 7 
images. Jass men 
The association between lower- sy 
bership and antisocial behavior 5 
Partially reflective of the freer rein ai 
gressive impulses in this group 45 4o 
by previous authors. It is importa” vio 
however, that when antisocial ae 
occur, whether it be among middle- s 
class Ss, these individuals manifest int! jg 
aggressive impulses and/or a weak?’ vides 
Control system than nonantisocial 1 
Thus the distinguishing feature iS 


put 
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vidual impulse-control balance, although spe- 
cific cultural groups may tend to foster vary- 
ing types of impulse-control balance with 
Tespect to aggression. 


The analysis of remoteness of aggression is 
related to the problem of symbolic repre- 


Sentation of impulses and conflicts in projec- 


tive data. This investigation demonstrated 
that antisocial Ss were more direct in their 


expression of aggression than nonantisocial 
Ss. It appears, then, that defensive inhibitions 
alter not only the sheer quantity of aggres- 


Sive themes but also the way in which they 


are formulated. This is a common enough 


Clinical observation but one which does not 
Seem to have been given sufficient weight in 
€xperiments concerned with the problem of 
inferring behavioral tendencies from projec- 
tive material. 

Anticipation of punishment as a conse- 
uence of aggressive behavior was no more 


Prominent among nonantisocial Ss than anti- 


Social Ss, This is not to say that such ex- 
Pectation may not serve to deter antisocial 
action in many instances. However, the re- 
Sults do suggest that it is not one of the criti- 
Cal distinctions between the two groups. On 
€ other hand, a significantly larger number 
of punishment themes unrelated to aggression 
®ither as retaliation or justification was char- 
acteristic of Group I Ss. The content of 
mes classified in this manner suggests a 
Steater awareness and acceptance of external 
itection and restraint. This finding may re- 
ate to the demonstration by Pastore (7) of 
e importance of perceived arbitrariness 
the frustrating situation as a determinant 0 
88ressive reaction. , 

S noted earlier in this paper there is a 
arked tendency for antisocial Ss to justify 
eir aggressive reactions by pointing to the 
arsh treatment imposed on them by others. 

antisocial individuals can prove that the 
°rld is against them, then there is no need 

a Tecognize any obligations to others. The 
ay fact that they so frequently find it nec- 
“sary to resort to this projection technique 
s'Bues that the delinquent ego is busily en- 
ee in disposing of still existing zemni 
of Suilt. One of the implications of this na e 
tp fairs is that any general policy of retalia- 
9n only reinforces this defensive maneuver 
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and makes it easier for the delinquent to pur- 
sue his antisocial course on a guilt-free basis. 
The basic importance of internal controls in 
the inhibition of antisocial behavior is amply 
demonstrated by the data. Certainly the eva- 
sion of guilt, shame, or remorse is a far more 
vital mark of the delinquent than any lack of 
awareness concerning potential external pun- 
ishment consequent to antisocial behavior. 

Another pertinent topic involves the hy- 
pothesis that fantasy behavior has a com- 
pensatory function. Tomkins (10) assumes 
this hypothesis in stating that TAT aggres- 
sive fantasies are found more commonly 
among neurotics and normals than antisocial 
characters. The results of the present study 
suggest that the opposite is the empirical fact, 
given Ss differing widely in antisocial be- 
havior. However, this finding is not neces- 
sarily contradictory to the fantasy substitu- 
tion hypothesis. One possibility is that the 
more potent and numerous aggressive im- 
pulses of the antisocial Ss obscure any rela- 
tive increment in fantasy aggression in the 
nonantisocial Ss. An alternative suggestion 
mentioned earlier is that fantasy is not uni- 
versally employed as a defensive or adaptive 
measure. Clinical experience tells us that in- 
dividuals differ widely in the use of fantasy 
and it may simply be that many directly 
hostile individuals have not learned to resort 
to fantasy for substitute gratification. 


Summary 


This study has relevance to two problems. 
Its first interest was to examine certain per- 
sonality variables, particularly in terms of 
the impulse-control balance, in order to es- 
tablish their relationship to overt aggressive 
tendencies. The TAT was the instrument 
through which information was gathered 
about the nature of and interrelationships 
between aggressive impulses, anticipated in- 
ternal punishment, and anticipated external 
punishment. The second major issue con- 
cerns the relationship between fantasy and 
reality behavior and the task of formulating 
from projective data alone the various cues 
which might permit differential predictions 
about behavior tendencies insofar as overt 
expression is concerned. 
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SP eer n young adult soldiers, the large 
m of ont basic trainees and pe 
them psychiatric referrals to the Mental r 
giene Clinic, served as Ss. On the basis S 
social history data covering aggressive an 
antisocial behavioral manifestations in both 
civilian and military life, each S was rated as 
to overt antisocial tendencies. It was found 
that antisocial Ss differ from nonantisocial Ss 
in quantity and quality of fantasy aggressions, 
the former producing not only a larger num- 
ber of fantasy aggressions but also finding it 
less necessary to obscure or minimize the 
hostile impulse. The superego variable as 
measured by anticipated internal punish- 
ments was found to be of far greater sig- 
nificance in inhibiting antisocial behavior than 
fear of retaliatory punishment which did not 
even differentiate between groups. An inter- 
esting finding dealt with the tendency of 
antisocial Ss to utilize themes of external 
punishment as a justification for their fan- 
tasy aggressions. Some of the implications of 
these results were discussed. An effort was 
made to deal with the problem of socioeco- 


nomic class factors as they might relate to 
the data. Finally, emphasis was placed on the 
fact that, for behavioral Prediction from pro- 
jective material, the same attention must be 
given to Tepressive, inhibitory forces mani- 
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is gi impulse 
fested in the data as is given to the imp 
or drive system. 
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Situational Influences on Rorschach Responses 


Edith M. Henry and Julian B. Rotter 


The Ohio State University 


The widespread use of “projective” tests for 
purposes of diagnosis and prediction of be- 
havior has stimulated extensive research in- 
vestigating the validity of the underlying as- 
sumptions of these tests. One of the most 
significant areas in which research has raised 
questions is that of the effect of immediate 
Influences on projective test productions. In 
Social learning theory (14, 15) such influ- 
€nces are conceptualized as the effect of the 
Psychological situation on behavior. 

A growing body of literature demonstrates 
that many factors other than an individual's 

asic personality structure are operating in 
any test situation, and that these factors are 
important determiners of the types of re- 
SPonses to be given. That is, individuals adapt 
their behavior to the total environment in 
Which they find themselves, and external 
Stimuli as well as inner motivations and dy- 
namics shape behavior at any given time. 

e present study is an attempt to show 
urther the importance of situational factors 
and to predict the types of changes in re- 
SPonse which will occur as 4 result of a par- 
ticular type of change in the testing situation 
Utilizing the Rorschach Test. 

„More specifically this study is concerned 
With the subject’s (S’s) belief regarding the 
Durpose of the test as it affects his test re- 
SPonses, A number of previous investigations 
(3, 4, 7, 9, 10, 11, 12, 16) have dealt with 
Sther kinds of situational influences on the 

°rschach test, including such variables as 

© effect of immediate stress, the ses and 

“rsonality of the examiner, suggestion, and 
Den Physical place of testing. There have also 
Hag a number of studies more closely re- 

€d to the present one. 


consistent effect of 


Fosher, *, 
g (5, 6 d little c 
i Seon ble and the worst 


ask; ; 
king Ss to make the best possi 


impression without, however, clarifying how 
should do this. Carp and Shavsin (2) een a 
similar study found intra-individual differences al- 
though there were no statistical group differences. 
That is, Ss changed their responses considerably but 
they did not do so in a consistent manner. Luchins 
(13) in investigating why Ss did not give certain 
kinds of responses in the early part of the Rorschach 
test found that one of the more frequent reasons 
was the S’s fear of being labeled “psycho.” Other 
reasons also implied that the S was responding to 
his interpretation of the purpose of the test. Simi- 
larly, Hutt, Gibby, Milton, and Pottharst (8) have 
shown that variations in instructions will produce 
significant variations in responses. Schachtel (17) 
has discussed in detail how the S’s implicit definition 
of the Rorschach test will affect responses but has 
not investigated these experimentally. 


In the present study, the situational vari- 
able of the S’s definition of the test was ma- 
nipulated and then investigated. It was felt 
that one of the most widespread views of the 
Rorschach, resulting from publicity of mass 
media, is that the Rorschach test is a meas- 
ure of “sanity,” that this test will uncover 
imbalances in a person’s emotional life. In ac- 
cord with the previous discussion, it was hy- 
pothesized that such a view of the test would 
alter an individual’s responses in the direc- 
tion of caution and the giving of only what 
most Ss would consider to be “safe” re- 
sponses. In order to test these assumptions, 
the experimental Ss were given instructions 
about the test which included the suggestion 
that this test is designed to discover emo- 
tional disturbances of a serious nature in 
mental patients. An underlying assumption 
of the study was that, when Ss respond in a 
particular way after being given a hypothesis 
about the test, these responses are compa- 
rable to those of another individual who 
holds the same hypothesis implicitly. The 
following hypotheses were formulated: 


457 


458 


The experimental group will give < 
cantly; <a) fewer responses in tota 
than will the control group; (6) = Te- 
sponses scored as form (F)'than will br con- 
trol group; (c) more responses of goo om 
level (F +) than will the control groups; @) 
more large detail (D) responses than al the 
control group; (e) fewer whole (W) re- 
sponses than the control group; (f) more 
popular (P) responses than will the control 
group; (g) more animal (4) responses than 
will the control group; (4) fewer responses 
of an aggressive and violent nature than will 
the control group. eG 
In all these hypotheses the assumption is 
made that Ss in the experimental situation 
will give, in the main, those Tesponses which 
they consider to be “safe,” inhibiting those 
which they consider suspect, those which 
would tend to place them in an unfavorable 
light. That is, they will give more responses 
which are conforming, which they expect to 
be similar to what most other people would 
see on the same blot or area, The present 
study differs from other Rorschach studies 


in that a situational variable is manipulated, 


and hypotheses are formulated about the 
changes in the dete 


tminants on a logical, 
“common-sense” basis rather than on the ba- 
sis of the usua 


theoretical meaning of the 
various determin: 


stance, was fo 
eral tendency 
Similarly, 
of its theoreti- 
cal meaning as a measure of intellectual con- 
trol but rather because form responses are 
often easier to see and those based on Color, 
texture, or movement are frequently less Clear 
and would be considered suspect, Large de- 
tail responses, again, were believed to corre- 
spond to the more obvious percepts; the pre- 
ponderance of popular responses is in line 
with a “common-sense” attempt at caution 
and safety, at seeing things as most other 
people are likely to see them. The hypothe- 
sized increase in animal responses concurs 
with an increase in popular responses. The 


‘Edith M. Henry and Julian B. Rotter 


i nimal re- 
- assumption that a large number of a 


sponses suggests intellectual mA E 
not employed. It was felt that a a a 
aggressive and violent types of re ae 
would result from attempts by Ss pot A 
their responses as innocuous as pnt ae 
inhibit any signs of lack of contro 
feelings. 


Procedure 


y ts in 
Subjects. Sixty female college ale di 
elementary psychology were ran 
lotted to two groups of thirty. sermen? 
Procedure. When S entered the cee 
tal room, she was asked the following 
questions: 


test 
“Have you ever heard of the Rorschach tive 


ffirma! 
the inkblot test?” If the response was @ 
the following question was asked: Gari what 
“Tell me what you semenit ont è i 
do you think it does? What is it for ecorded bY E 
Responses to these questions were i r the expen 
who then gave the main instructions. Fo 
mental group these were: o on 3 
“This is a series of cards with mbna blots ee 
People look at the cards and tell wha test bas a 
mind them of. For many years the tional distur 
used in mental hospitals to study emo disturbed ie 
ances and to discover how seriously college surv! 
tients were. Now we are making a oe 
with it. lots and tell e 
“Now I want you to look at the : te to yo cat 
what they could be, what they loo ce all differ 
what they remind you of. People S 


ight of 
things in the blots—there are no rig 
answers,” 


every 

u 
The individuals in the control gf0¥P? 5i out 
second S, were also asked the aie test, 2° 
their previous acquaintance with uc 


r ins 
then were given the standard Klopfe 
tions: 


them 

“This is a series of cards with inkblots at w 
I want you to look at them and tell mr what tipe 
could be, what they look like to you, Things ap 
remind you of, People see all different wers.” 
blots—there are no right or wrong ans gmin" 
Foilowing this, the Rorschach m and ° 
tered in the standard manner to a re 
fairly thorough inquiry followed. 1 SS wa 

After the test, the experimen = esi se 
asked a number of general qe a iver? 
to elicit information about the € 


of the instructions, 


Situational Influences on Rorschach Responses 


Scoring. All identification was removed from 
the records, and the protocols were scored ac- 
cording to Beck’s (1) manual. An independ- 
ent rater then scored twelve records, also 
using Beck’s criteria. A short scoring manual 
Was constructed for the presence of content 
involving aggression or violence. The cate- 
Sories used were as follows: explosions; fire; 
blood; people or animals battered, beaten, or 
demolished; fighting or killing; monsters in- 
Volved in some kind of threatening action. A 
frequency count of these themes was then 
made by the experimenter and by the same 
Independent rater. 

Statistical methods. To test reliability, a 
Percentage of agreement was computed be- 
tween the two scorers on twelve records. A 

arson product-moment correlation was used 
to test reliability of scoring for aggressive 
Content on all sixty protocols. 

To test the hypothesis dealing with total 
number of responses, a ¢ test for differences 

etween means was used. For all other hy- 
Potheses, two different techniques were used. 

he first technique involved converting all 
Scores to percentages and then computing ¢ 
tests for differences between the means of the 
Percentages, The second technique was essen- 
tially a method of equalizing the scores to 
account for any differences in productivity 
(Total R) between the two groups.” 


lly to acknowl- 


s ik teful 
The authors would like gra! Mischel in this 


edge the assistance of Mr. Walter 
Tespect. 

“We are grateful to Dr. Robert Wherry who sug- 
Bested a method for equalizing the effects of an = 
“qual number of responses in the two groups. z 
“qualize scores the following steps were taken, o 
ĉach variable except R: (a) The total number o. re 
Donses for both experimental and control groups 
yas computed; (b) The total number of sepan 

any particular variable, such as F, were a = 
Puted, and this number was divided by the to R 
give a predicted score on the variable under _ 
eration for the group as & whole; (c) To amine 
an individual predicted analy pate preni = 
pre was Itiplied by each indi 
This predicted score was then ale = 
individual’s actual score on the varia e aE 
wesidered. This score served as an ee Fes 
ete each jndividual’s score fell in relation to = 
core that would be predicted from total group P 
“tmance. These scores were then used in the com- 
tation of ż tests of significance between the means 


0 
Ë the two groups. 


Si 
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Results 


Reliability of measures. Percentages of 
agreement were calculated between the scor- 
ing of E and an independent rate on twelve 
protocols. (On the remaining protocols, the 
£’s scoring alone was used with all identifica- 
tion first removed from the records.) Separate 
computations were performed for location, de- 
terminants, and content. The percentage of 
agreement for scoring of location was .95, for 
determinants,. .82, and for content, .92. A 
second reliability check concerned the scoring 
for aggressive and violent content, scoring 
having been based on a brief manual con- 
structed by Æ. Here, all sixty protocols were 
used. Pearson product-moment correlations 
were used here, with separate computations 
for the experimental and control groups. The 
correlation coefficient for the experimental 
group was .83, and for the control group, .66. 

The results of the tests of the experimen- 
tal hypotheses are given in Table 1. 

a. R (total responses) lower in experimen- 
tal than control group: The experimental 
group mean was 16.07, and the control group 
mean was 23.47. A £ of 4.11 supports the hy- 
pothesis beyond the .001 level of confidence. 


Table 1 


Sigmas, Means, ts and Significance of Differences 
Between Means for the 30 Experimental 
and 30 Control Subjects 


Variable ce Meane se Meane ¢ ? 
Responses 6.20 16.07 7.52 23.47 4.11 <.001 
From Equalized Scores 
Popular 1.85 56 197 —.56 2.23 <.05 
Form 2.43 76 3.56 —.75 1.88 <.10 
Form-Level 1.17 66 2.49 —.67 2.62 <.02 
Aggressive 1.94 —.48 1.80 —.12 1.28 <.20 
Animal 2.14 .73 2.86 —.74 2.25 <.05 
Whole 3.48 15 5.04 87 63 <.60 
Detail 3.91 23 3.97 22 02 <.90 
From Percentages 
Popular 12 32 04 26 2.29 <.02 
io 419 72 = 13 61 2.50 <.02 
Form-Level .08 87.08 80 2.70 <.01 
Aggressive Ji 07 10 .10 1.08 <.20 
Animal 14 53) 12 43 293 <.01 
Whole 23 > AS 46 44 92 <.40 
Detail .24 50 .70 49 «0s <.70 


I 
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5. More F (form) responses in experimen- 
tal than +control group: Using equalized R 
scores, means of .76 and — .75 were obtained 
for the experimental and control groups, re- 
spectively. A ¢ of 1.88 was obtained, which 
yields a p value between the .05 and .10 ley- 
els and tends to substantiate the hypothesis. 
Using percentage scores, the mean value for 
the experimental group was .72 and .61 for 
the control group. A ¢ of 2.5 supports the 
hypothesis between the .02 and .01 levels of 
confidence. 

c. More F+ (good form level) responses 
in experimental than control group: With 
equalized scores, means were -66 and — .67 
for experimental and control Sroups, respec- 
tively. A £ of 2.62 supports the hypothesis 
between the .02 and .01 levels, A ¢ calculated 
from percentages yielded a value of 2.70, sig- 
nificant beyond the .01 level in the predicted 
direction. Mean values were .86 and .80 for 


the experimental group and the control group 
respectively, i 


e. Fewer W i 
ponses in experi- 
mental than control group: Using eniai 


scores, a mean of .15 was Obtained for the 
experimental group and of ‘87 for the con 
trol group. A ¢ of .63 with equalized sers 
and .92 with percentage scores did not sike 
stantiate this hypothesis. Means with per- 
centage scores were .45 and 44 respectively, 

f. More P (popular) responses jn experi- 
mental than control group: Experimenta] 
group mean, with equalized Scores, was 56. 
control group mean was — .56, A t of 2.23 
with equalized scores lent support to this hy- 
pothesis between the .02 and .05 level. With 
percentages, means were .32 and -26, respec- 
tively. A ¢ of 2.29 supported the hypothesis 
between the .025 and .01 levels, 

g. More A (animal) responses in experi- 
mental than control group: Using equalized 
R scores, means were .72 and — .74, respec- 
tively. A ¢ of 2.25 supports this hypothesis 


Edith M. Henry and Julian B. Rotter 


between the .02 and .01 levels. With percent- 
ages, means were .53 and .43 for experimen- 
tal and control groups, respectively. With ¢ 
calculated from percentage scores, signifi- 
cance was between the .01 and .001 levels. 

h. Fewer aggressive responses in experi- 
mental than control group: With equalized 
Scores, means were — .48 and — .12, respec- 
tively. A Z of 1.28 fell between the .10 and 
-20 levels of confidence. Using percentage 
Scores, means were .07 and .10, respectively. 
A ¢ of 1.08 also fell between the .10 and .20 
levels, and, therefore, did not significantly 
substantiate this hypothesis but was in the 
right direction. 


Discussion 


The results of this study, in general, rea 
to substantiate the hypotheses advanced. a 
regard to aggressive responses, the total nu j 
ber produced in the group was too few to a 
tain significance in the results and the = 
sumption that the more conforming as 
Were frequently more D than W wae ing 
borne out. The other hypotheses TOE eet 
the number of responses, the number of and 
responses, form-level, popular responses S 
animal responses, were all supported 
highly significant degree. ot 

The real significance of this study does ait 
lie in its demonstration of the effect of 4 the 
ferent type of instructions but rather in out 
implications that subjective hypotheses ve t 
what the test is testing will have a si t 
effect on the S's responses. As applied Be is 
Rorschach test some specific informal” ect 
Presented in this study as to what that p Der 
may be when the S has the hypothesis o m 
lief that the test is essentially a test ology? 
Sanity, mental disturbance, psychopathe oy 
etc. Such a belief is probably fairly pean 
held as a result of the widespread poP¥ e at 
tion of the Rorschach through magazin did: 
ticles, Sunday supplements, movies som” 
television, and also through direct ong 
munication. The results support A i 
Schachtel’s assertion that it is extreme * pat 
portant for an examiner to find OU t ares 
these implicit beliefs regarding the tt of 
and to evaluate test results in the V8 
them. 


SE O 


Situational Influences on Rorschach Responses 


It is of some interest that the general ques- 
tioning of the Ss following the test adminis- 
tration did not reveal too much in the way of 
awareness that the Ss were trying to appear 
in a good light, not mentally disturbed, etc. 
Some Ss after considerable pushing would 
finally agree that they tried to avoid men- 
tioning anything that might sound peculiar, 
but in general, more prediction could prob- 
ably be obtained by assuming certain effects 
likely to occur as a result of the S’s hypothe- 
Ses about the test purposes than could be ob- 
tained by questioning the S regarding his 
Motives in taking the test. 

The study also tends to support, at least 
by implication, the general notion that con- 
Ceptualizing the S’s behavior (including test 
Tesponses) in a test situation as an attempt 
to reach some goal to give a particular kind 
of impression or to defend himself against 
Some threat can be a useful predictive method 
from a common-sense point of view. 

The results also tend to support the now 
Stowing body of literature which emphasizes 
the need to interpret psychological test re- 
Sults in light of a host of situational variables, 
no matter how indirect the test, rather than 
limiting analysis to the test protocols or pro- 

les obtained from several tests or subtests. 


Summary 


This study measured the influence of one 
aspect of the psychological situation, knowl- 
edge of test purpose, on responses to the Ror- 
Schach test. The Ss were sixty female stu- 
dents in elementary psychology. Experimental 
Ss were told that the Rorschach is used to 
discover serious emotional disturbances, then 
given standard Klopfer instructions; control 
Ss received only Klopfer instructions. Hy- 
Potheses were that experimental Ss would 
Bive fewer total, aggressive, and whole A 
Sponses; more pure form, good form-level, 
Popular, animal, and large detail responses. 
The specific hypotheses all involved the A 
eral hypothesis that experimental Ss woul 

e cautious and conforming. Results were 
analyzed by two methods for every variable 
€xcept total responses. By one, Taw scores 
Were converted into percentages, and ¢ tests 
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computed. The second involved a technique 
of equalizing scores to eliminate any influence 
of reduced number of total responses in one 
group. With total responses, #’s were com- 
puted on differences between means. Results 
showed fewer responses in experimental group 
(beyond the 1% level), more good form- 
level, popular, and animal responses (be- 
tween 5% and 1% levels), more form re- 
sponses (between 10% and 5% levels), fewer 
aggressive responses (between 20% and 10% 
levels). Location did not vary significantly 
between groups. 

The results tend to support the general hy- 
potheses that: (a) a knowledge of the S’s be- 
liefs regarding the purposes of the test should 
be an important aspect of the interpretation 
of the test, (b) a “common-sense” analysis 
of the S’s approach to the whole testing 
situation would be a fruitful part of the test 
interpretation, and (c) situational determi- 
nants significantly influence test responses. 
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to respond in the usual manner to Cards IIT 
and VII of the Rorschach. The sample was 
then divided at the median into High (2 or 
more) and Low (less than 2) M groups. It 
was determined that there was no significant 
difference between the two groups in the 
number of Ss who responded with an overt 
expression of affect (x? = .12, p = -70). Thus 
the record was successful in inducing an im- 
pulse to laugh, and the expression of that im- 
pulse, regardless of the amount of M pro- 
duced by the Ss. 

Sixty-eight additional Ss from the same 
general population were introduced to the 
same experimental procedure with one cru- 
cial modification. Prior to hearing the record, 
Ss were instructed zoż to smile or laugh. This 
sample was similarly divided at the median 
into high M and low M groups. The two 
groups were compared on their success or 
failure in controlling the expression of the 
experimentally induced affect. 

It is to be noted that 
administered following t 
order to rule out any bia 
affective response, Thus 


a third psyc 
the deciding factor. 


Results 


Results were in the Predicted dj 
the 34 Ss in the high M group 
to listen to the entire i 


rection, Of 

20 were able 

hout any ob- 
Table 1 

Affective Control of High and Low M Groups 


Successful Fail 
Group Control Contes 
High M (2 or more) 20 14 
Low M (less than 2) 11 23 
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servable display of feeling. Only 11 of the 
34 Ss in the low M group were similarly suc- 
cessful (Table 1). 

Since the direction was hypothesized, a one- 
tailed test of significance was used. The ob- 
tained chi square of 3.79 is significant at the 
03 level. Analysis of the data in terms of the 
total number of responses (R) reveals that 
the obtained relationship is not dependent 
upon R (x?= 1.27, p> .20). Tetrachoric 
Correlation between AZ and affective control 
was .42 (p < 01). 


Discussion 


These results support the hypothesis ag 
Significant positive relationship between E 
and the voluntary inhibition of expression i 
an experimentally induced impulse to laug f 
Although these data cannot be generalized to 
the control of other affects, one could a 
pothesize that further experimentation W! š 
other affects would reveal similar relation 
ships. ice 

It is of interest to speculate about the pror 
esses involved in controlling affective oe 
sion. Is there any fundamental eager’ 
Process between the inhibition of the A c 
sion of an affect and the control of the af oat 
itself? The two may be equivalent only $ er. 
the point of view of the outside observe 
Controlling affective expression ee 
have both motor and cognitive rage 
A person can keep from expressing an ling 
pulse to laugh, for example, by ingen 
Certain facial muscles. The affect can ren e 
even though its overt expression is =“ re- 
by motor means. Some of the subjects 
Ported that they felt very much like ie 
ing, but restrained themselves by _clen¢ 
their teeth and compressing their lips. 

The other way of controlling the oe 
of affect is through the modification ° ses 
affective tone itself by cognitive an 
Which alter the autonomic reaction Pa ject’ 
By way of illustration, one of the sub) by 
Teporteil that she kept from laughin’ py 
thinking of her mother dying. She was ine 
able to change the affective tone throug g 
nitive means. The affect need not be ee 
to the extent of substituting an opposite of 
as thoughts could be used in a variety el 
ways merely to neutralize the existing 


sio? 


p 
eee 


Affective Control and Rorschach Human Movement Responses 


ing. We have already cited experiments which 
have demonstrated that the abilities to inhibit 
Motorically and cognitively are each corre- 
lated with 4f. If voluntary control of the im- 
pulse to express an affect is viewed in terms 
of its motoric and cognitive components, the 
Present experiment may simply be reflecting 
these relationships in a more complex setting. 
As suggested above, there may be two basic 
Styles of inhibiting affective expression—one 
Primarily motoric, and the other principally 
Cognitive. We might speculate further and in- 
voke a concept of motor-cognitive vicarious- 
ness. This would point up the possibility that 
Motor inhibition tends to lead to the produc- 
tion of thoughts or fantasies which in turn 
Serve to modify the affective tone. Observa- 
tions and reports from the Ss suggest that 
their initial adaptation to the task was 
through motor control. It appeared that this 
Was later supplemented by cognitive meth- 
Ods at different stages according to the indi- 
vidual. This progression from motor to COS- 
nitive control can be thought of as a re- 
Capitulation of the developmental process, in 
that the ability to use cognitive processes to 
control feelings might be expected to appear 
at a later stage of personality development. 
bservations of young children suggest that 
control largely through motor means a 
Stadually supplemented by the SS a 
4 variety of cognitive techniques whicl - 
Modify the affective state. When these mecha- 
nisms are refined in the normal adult, it he 
more difficult for the observer to detect ily 
affective state than it is in the emotionally 
e state t be 
labile child. We would expect different be- 
avorial and symptomatic pania ale 
adults with these two different styles o mp 
trol in accordance with the \ Sai = 
their chronic reaction pattern. ie hoa be 
Anticipate different symptom comp CXS otor 
dividuals who are chronically exerting 
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control in contrast to others whose control is 
exercised largely through thinking., It would 
therefore be important to contrast individuals 
who are found to utilize predominantly one or 
the other of these methods from the point of 
view of relating their style of control to devel- 
opmental levels and to the complicated prob- 
lem of symptom choice in psychopathology. 


Summary 


Previous experiments have demonstrated 
motor and cognitive inhibition to be behav- 
ioral correlates of Rorschach Human Move- 
ment responses. The present study extends 
the relationship of M and inhibition ability 
further to include the control of affective im- 
pulses as well. An impulse to laugh was in- 
duced, and Ss instructed to refrain from any 
affective expression. In support of the hy- 
pothesis, more high JZ than low M subjects 
were successful at inhibiting any overt ex- 
pression of the experimentally induced affect. 


Received February 21, 1956. 


References 


“. Levine, M, & Meltzoff, J. Cognitive inhibition 
and Rorschach human movement responses. 
J. consult. Psychol., 1956, 20, 119-122. 

Meltzoff, J., & Levine, M. The relationship be- 
tween motor and cognitive inhibition. J. con- 
sult, Psychol., 1954, 18, 355-358. 

Meltzoff, J., Singer, J. L., & Korchin, S. J. Mo- 
tor inhibition and Rorschach movement re- 
sponses. J. Pers., 1953, 21, 400-410. 

. Singer, J. L., & Herman, J. Motor and fantasy 
correlates of Rorschach human movement re- 
sponses. J. consult. Psychol, 1954, 18, 325- 
331. 
5. Singer, J. L., Meltzoff, J., & Goldman, G. D. Ror- 
schach movement responses following motor 
inhibition and hyperactivity. J. consult. Psy- 
hol., 1952, 16, 359-364. 

tiene, ia L, & Spohn, H. E. Some behavioral 
correlates of Rorschach’s experience type. J. 
consult. Psychol., 1954, 18, 1-9. 


Ww. 


al of Consulting Psychology 
RG, No. 6, 1956 


The Use of the Kaleidoscope as an Adjunct 
to the Rorschach 


Emanuel Starer 
VA Hospital, Northport, N. Y. 


One of the problems encountered in the 
psychological testing of many chronic psy- 
chotic patients is that they frequently pro- 
duce only ten or fewer responses on the Ror- 
schach. As a result, the examiner is hampered 
in his attempt to describe the underlying per- 
sonality structure in detail. 

The writer has employed the kaleidoscope 
with 20 chronic patients, with the instruc- 
tions to report whatever was seen. After the 
patient had finished associating to a given 


to shift the ka- 
omatically intro- 
this manner an 


ponses obtained on 


s muli and produced 30 
responses which were i 


some of his areas of conflict. 


Examples of some of 
the kaleidoscope include those frequent 


from the Rorschach such as: bugs, butterflies, bats, 
insects, plants, flowers, and designs, T 
in nature. 


the responses obtained with 


Š ed: 
Responses containing a color component ee 
a bloody rag, two big red blotches, face ‘iscolored 
with red eyes and red nose, and I see a dis 
ball, sort of pale and brown. imal, 
Some of the responses containing Hunan big 
or inanimate movement included; man’s fa of h 
of stupid looking with sharp nose, Sm who is 
Lord, He’s bowing His head, face of a oe a 
ready to eat you up, crabs clawing an ia at me 
spider making up his mind whether to pO n object 
or not, three bolts of lightning hitting a 
from three different directions. nalized 85- 
Finally, some examples of highly perso the ones 
sociations included: pair of ice tongs nee Dutch de- 
used when a boy, type of Pennsylvania of the 
sign, a hex sign, insignia of the devil, Pe at for 
uterus, mop of hair of a child, panca 
young lady, and motor neurone. 


mmended 
ociations 
sidere 


The kaleidoscope technique is reco 
only when there is a paucity of ass 
on the Rorschach, and so can be cO patio 
only an adjunct. Much valuable info can 
is lost since only a content analysis e 
made. Perhaps the most a no 
many investigators is that the siimus ted. 
constant and so can not be redup ien i 
spite of these and other objections, o 
aminer has found the adjunctive es to Þe 
Kaleidoscope in personality evaluatio use i” 
Worthy of further investigation an articu- 
Practical clinical testing situations, P 
larly with chronic psychotic patients. 


ex 
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The Use of Human Figure Drawings in the 
Diagnosis of Organic Pathology 


Marvin Reznikoff and Donald Tomblen 
The Institute of Living 


„Clinical psychologists are often asked to 
aid in the differential diagnosis of organic 
Pathology. One of the widely used techniques 
in psychodiagnostics is the human figure- 
drawing test. Experience has suggested that 
this relatively unstandardized method may 
Prove to be useful in attempting to evaluate 
the presence or absence of organic difficulties, 
but there are relatively few published studies 
in this area. Michal-Smith (2) reported the 
Tesults of the H-T-P technique, comparing 
boys whose EEGs were abnormal with boys 
Who were found to be normal with reference 
to their EEGs. Only one sign yielded a sig- 
nificant difference, namely, “line quality.” 

_ Machover (1) and Vernier (3) both listed 
indicators which they mentioned as “often 
Seen” in the organic case. For Machover, 
these included: disproportionately large head; 
empty, large, poorly proportioned figures; 
Weakly synthesized drawings; and simple, 
heavy line quality. Vernier suggested “petal” 
or scribbled fingers; center-of-page place- 
ment; shrunken arms and legs; erasures mm 
arm and hand area; and eyes drawn as slits. 

n agreement with Machover, she also listed 
argeness of head and whole figure; empti- 
ness, or lack of detail; weak synthesis; and 
Poor proportions. However, she described the 
line quality as sketchy and/or broken, rather 

han heavy and simple. 


The present study wa e 1 
Vestigate: (a) the degree to which these vari- 


Ous suggested indicators are actually more 
Characteristic of the drawings of organic pa- 
ients than they are of the drawings of other 
Psychiatric groups, and (b) the extent to 
Which these indicators may reliably be em- 


s undertaken to in- 


ployed in the differential diagnosis of or- 
ganicity. 
Procedure 


Sample. Three groups of 25 patients each 
were selected from the files on the basis of 
final diagnoses, which in this institution fol- 
low the criteria and classifications described 
in the Diagnostic and Statistical Manual of 
Mental Disorders prepared by the American 
Psychiatric Association. In one group, all pa- 
tients had been given organic diagnoses, spe- 
cifically “chronic brain syndrome.” Another 
group of patients were diagnosed as schizo- 
phrenic, and the last group as having neurotic 
disorders. Organic findings were entirely ab- 
sent in the schizophrenic and neurotic groups. 
All patients were at least average in intelli- 
gence and between 19 and 55 years of age, 
with a mean age of 35.4 years. All patients 
had drawn human figures during routine psy- 
chological testing. The patients had not been 
tested by either author, nor was any informa- 
tion about the personal history, diagnosis, or 
results of other psychological tests available 
to the authors when they scored the drawings. 

Scoring method. A list of 17 indicators was 
compiled, based upon those suggested in the 
literature plus several others derived from the 
personal experience of the senior author. 
Scoring criteria for each indicator were de- 
lineated. In the instance of No. 15, “En- 
larged figure size,” actual measurement of 
the drawing length was recorded. For all 
other indicators, a simple plus-minus system 
was used. If an indicator was clearly present, 
it was scored plus; otherwise, it received a 
minus score. The indicators were: 
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Table 1 


Analysis of Variance of Drawing Size Measurements of 
Organic, Schizophrenic, and Neurotic Patients 


Source of : Mean 

variation df square F 
Between groups 2 6.24 1.15 
Within groups £ 72 5.44 

Total 74 


. Emptiness of figure (lack of details) 

. Weak synthesis (parts loosely joined) 

. Parts misplaced (noticeably shifted) 

. Disproportionately large head 

- Shrunken arms and legs (thinner and shorter) 

. Other parts distorted (inappropriate size and/ 
or shape) 

- “Petal” or scribbled fingers 

. Eyes drawn as slits 

. Center-of-page placement 

. Erasures in arm and hand area 

. Erasures elsewhere 
drawing) 

. Heavy, simple line quality 

- Sketchy line quality 

. Broken line quality 

- Enlarged figure size 

- Unlifelike pose 


. Erasures with only minimal improvement 


Ou WWE 


m 
FOowx 


(two or more in single 


me ee 
ISa N 


Between Groups o 
Patients of Twenty. 


Frequency of 


occurrence 
i 
Or- Neu- Chi 
i i i 
Indicator ganic rotic square b 

Weak synthesis 15 1 E 
Parts misplaced 15 1 et Mi 
Shrunken arms and 001 

legs ma 2 11.12 
Parts other than head -001 

and extremities dis- 

torted 15 3 10.50 i 
Petal or scribbled 

fingers 4 5.70 o2 
Emptiness of figures 15 5 6.15 ‘o1 
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Two indicators proved to be unscorable in 
practice and therefore were eliminated. These 
were: No. 16, “Unlifelike pose,” and No. 11, 
“Erasures with only minimal improvement, 
both original with the authors. It was impos- 
sible to arrive at a satisfactory, objective 
definition of unlifelike pose, and it was like- 
wise extremely difficult to determine the wa 
gree of improvement after erasures witho 
actually observing the drawing process itsett 
On the 15 retained indicators scored for poke! 
drawing, there was 91 per cent interscor® 
agreement. Minor differences of scoring We" 


h diag- 
Id thus 
c wi 
be 25. Each group was then compared Tye. 
ed t 
e or 
ighe 
; ly Meis 


ndicators 


Present out of a possible total of 11 e 

IL). These scores were converted to 2a ne 
ages, and an angular transformation et 
in order to stabilize the variance. 1 to the 
sis-of-variance design was then applie s dis 
transformed scores of the 75 patien s 
tributed into the three diagnostic grov?” 


Results and Discussion janc® 

From the results of the analysis of wi gcant 
cited itt Table 1, which yielded nonsis” atient 
results, it is evident that the organic gures 
does not characteristically draw larget <? š 
than other patients. 14 ind 

Tables 2 and 3 show that 5 of the of 
Cators are indeed more characteristic either 
Sanic drawings than of drawings ° 


Human Figure Drawings and Organic Pathology 


schizophrenics or neurotics. An additional in- 
dicator, emptiness of figures, showed a sig- 
nificant difference between organic and neu- 
rotic productions, but not between organic 
and schizophrenic drawings. The remaining 
indicators occurred with approximately equal 
frequency in all groups, with any discrep- 
ancies attributable to chance factors. When 
schizophrenics were compared with neurotics, 
none of the indicators differentiated between 
the groups to a statistically significant degree. 

It may be noted here that Vernier’s sketchy 
or broken line indicator was present more 
Often in the organic group than was Mach- 
over’s simple, heavy line. However, neither of 


Table 3 
Drawing Indicators Showing Significant Differences 


Between Groups of Organic and Schizophrenic 
Patients of Twenty-five Each 


Frequency of 


occurrence 
a 
Or- Schizo- Chi 
Indicator ganic phrenic square p 
Weak synthesis 15 5 6.75 01 
garis misplaced 15 5 6.75 -01 
hrunken arms and 
legs 14 0 16.77 .001 
Parts other than head 
and extremities dis- 7 
torted 15 6 5.26 05 
Petal ibbled 
e 13 1 12.00 .001 


d to a greater extent 


these indi eare 
se indicators app they did in the 


in the organic group than 
other groups. 

Results of a final ana 3 
Table 4 and indicate the hi 
degree to which organic patients surpass both 
schizophrenics and neurotics in the number 
of indicators present in their individual draw- 
ings. 

Since the anal 
plied to the transformed trat 
a disparity among the three groups signifi- 
cant at the .001 level, the groups were next 
considered two at a time. The ¢ test was ap- 
Plied using the mean square value of the 
within-group source of variation (error term) 
as the pooled variance. Results of the com- 


lysis are reported in 
ghly significant 


ysis-of-variance design ap- 
scores demonstrated 
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Table + 


Analysis of Variance of Transformed Drawing Scores of 
Organic, Schizophrenic, and Neurotic Patients 


Source of Mean 
variation df square F 
Between groups 2 1612.19 13.65* 
Within groups 72 118.15 
Total 74 


* Significant at the .001 level of probability. 


parisons are shown in Table 5. It can be seen 
that the scores of the organic patients dif- 
fered from both those of the neurotics and 
schizophrenics at the .001 level of confidence, 
while the difference between scores of the 
schizophrenic and neurotic patients was not 
statistically significant. 

Although these indicators distinguish be- 
tween groups, it remains to be determined 
how effectively they can be utilized in indi- 
vidual differential diagnosis. Table 6 reveals 
that as many as 7 out of 11 indicators must 
be present in order to establish with certainty 
that the correct diagnosis is an organic one, 
rather than neurosis or schizophrenia. With 
such stringent requirements, one would miss 
nearly three-quarters of all organic cases! 
Reducing the number of indicators to 5 
would still result in 40 per cent false nega- 
tives and also in obtaining 4 per cent and 16 
per cent false positives from among the neu- 
rotic and schizophrenic groups, respectively. 
Since these predictions are based on the same 
cases as were used for the analysis of the 
indicators, it is likely that a greater number 
of false diagnoses would occur on cross vali- 
dation with a new sample. The evidence 
clearly points to the limitations of a naive 
reliance on a purely “sign” approach to the 


Table 5 


Separate Group Comparisons of Drawing Scores of 
Organic, Schizophrenic, and Neurotic Groups 


Comparison t p 
Organics with neurotics 4.66 001 
Organics with schizophrenics 4.16 001 
Neurotics with schizophrenics 0.49 not 

significant 
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Table 6 
Cumulative Distribution of Drawing Scores of Organic, Schizophrenic, and Neurotic Patients 
Organics Schizophrenics Neurotics 
Drawing Numberof %of Numberof % of Numberof % of 
score* patients patients patients patients patients patients 
1 or more 24 96 24 96 24 96 
2 or more 24 96 20 80 19 76 
3 or more 21 84 15 60 14 56 
4 or more 19 76 ri 28 6 24 
5 or more 15 60 4 16 1 4 
6 or more 12 48 1 4 1 4 
7 or more 7 28 0 0 0 0 
8 or more 4 16 0 0 0 0 
9 or more 1 4 0 0 0 0 


* Drawing score equals number of indicators recorded as present out of maximum of eleven. 


diagnostic task. Nevertheless, the sophisti- 
cated clinician may well utilize the more dis- 
criminating indicators as a basis for further 
investigating the possibility of organic pa- 
thology in a patient. 


Summary 


When the number of indicators present ne 
scored for the patient’s individual drawings f 
was found that the organics had significant y 
higher scores, but the groups overlap ped s 
a considerable degree, limiting the usefulnes 


of this approach alone for individual differ- 
ential diagnosis. 
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Certain Formal Characteristics of Human Figure 


Drawings by Institu 


tionalized Aged and 


by Normal Children’ 


Martin 


University of Illinois, 


Orthodox Jewish 
Chicago, 


human figure have been 
and studied as a psycho- 
ity assessment 
d as bases for 


_ Drawings of the 
fairly widely used 
soe diagnostic and personal 
ink maue; They have been use D 
ea erences about intellectual or maturity level, 
x nflict areas, and self concept Or “body im- 
a The present study is an investigation of 
self extent to which figure drawings reflect 
>i concepts or body images which may be 
els men to be characteristic of disparate lev- 
fea age and social status. The specific ques- 
a under consideration is whether figure 
Deane am a technique which is sensitive to 
1 nges in body image occurring from child- 
hood to old age. 
doe changes in body image might be an- 
ph pated in individuals who experience the 
ie ysiological vicissitudes associated with ag- 
u g is suggested by Schilder; “When we build 
p a persistent and coherent image of the 
body we build it up out of our emotional mood 
which is based upon biological tendencies . - - 
the changes in the þiological unit reflect them- 
selves in the more plastic image of the body” 
(4). 

Several stu 
ings of institutiona’ 
from the drawings ° 
mal adults. According to 
compared with the produc 
graduate students, those 
characterized by incomplet: 

1 Thanks are due Drs. Marion 

University of 


K. Rosenwald of the i 
of Medicine for their advice and cooperation 


study. 


dies have found that the draw- 
lized aged persons differ 
f certain groups of nor- 
one recent study, as 
tions of university 
of the aged were 
eness, lack of pro- 


Wieman and Alan 
Illinois, College 
in this 


Lakin 
College of Medicine 


Home for the Aged, Drexel Home for the Aged 


Illinois 


portionality, and lack of integration (2). 
Machover (3) has observed that senile indi- 
viduals draw small, puny figures, use rela- 
tively little area of the paper for the draw- 
ing and center the figure poorly upon it. 
These observations are interesting in view 
of current theory with respect to the tech- 
nique. In clinical work, gross departures from 
“normative” performances in terms of such 
formal variables as area, size, and centered- 
ness are frequently interpreted as suggestive 
evidence of deviant intrapersonal states. Area 


utilized, for example, is considered to reflect 
tion to the environment, 


self-assessment in rela 

Height is similarly interpreted as an indica- 
tion of feelings of relative self-significance. 
Centeredness is often considered to be affected 
by the subject’s general security level and by 
his orientation toward reality. 

Gross differences in self conceptualization 
and, presumably, in body image would be an- 
ticipated in a comparative study of the insti- 
tutionalized aged and normal children close 
to the threshold of adolescence. In one way 
their life situations are somewhat similar: 
both groups are explicitly dependent upon 
protecting and nurturant environmental forces 
for gratification of primary needs. However, 
as contrasted with the vigor, growth, increas- 
ing self-awareness, and recognition of poten- 
tial among the children, the psychological dec- 
rements which accompany the physiological 
changes in the aged are a matter of popular 
concern. Less of self-esteem, lessened vitality, 
and the sense of impending further decline 


seem to underlie the frequently observed ex- 
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Table 1 
“Identifying Data for Subjects 
Education N 
(yrs. of 
formal Fe- 
Mean Age schooling) Males males 
Institutionalized 
aged subjects 78.5 3* 13 11 
(N = 24) 
Normalchildren 8.7 3 10 15 
(N = 25) 


*Estimated because of discrepancies in education of aged 
who were all foreign born. 


pressions of futility and hopelessness among 
the institutionalized aged. The question is 
whether these differences are reflected in the 
figure drawings of the two groups. 

Such formal variables as area, height, and 
relative centeredness would appear to be ex- 
cellent points of comparison between the two 


of peripheral, 
d have to be 


of normal children. 


Method 


Twenty-five third grade children from a 
public school and twenty-four elderly resi- 
dents of a home for the aged were the sub- 
jects. All were administered the Figure Draw- 
ing Test (3) and were provided with similar 
materials, medium soft penciis and plain 84 
X 11 sheets of paper. The aged subjects were 
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given the test in individual examination ses- 
sions. The children were tested as a group. 
Instructions were limited to the simple direc- 
tions: “Draw a person; you may make it any 
way you wish, but draw a whole person, not 
just the face.” 

Table 1 describes the personal character- 
istics of the groups. The children were a typi- 
cal class of third graders. Those markedly 
high or low in previously administered Stan- 
ford Binet scores (above IQ 110 or below IQ 
90) were not included in the present sample- 
The institutionalized aged were also a fairly 
“typical” group, in terms of the home’s stand- 
ards. All were ambulatory and in “good” con- 
tact. Markedly deteriorated individuals an 
those considered to be grossly impaired intel 
lectually as evaluated on the basis of a 
Bender Gestalt Test and psychiatric inter- 
view, were not included in the study- 

Comparison of the aforementioned form 
characteristics of the drawings were under- 
taken as follows: 


al 


Area. The arca of each drawing was precisely 
measured by means of a geographer’s planimeter. es. 
instrument yields results in terms of square inc ere 
The areas of the two groups, treated as scores; Wo 
then compared. Because of the somewhat saan 
distribution of the data the nonparametric M° 
test was employed. fig- 

Figure height. The distance from figure top tO Jer. 
ure bottom was measured with an ordinary <9 
Heights to the nearest inch were treated as SCO 
The scores of the groups were then compare 
means of the median test. 4 incl 

Centeredness. A grid of concentric circles, pered 
apart, was constructed. Each circle was num late 
and regarded as a unit. By placing the grid-temP 
Over the sheet with the drawing, it was possib t 
measure the distance from the center of sheet et 
center of gravity (the midpoint between the feom 
extremities) of the figure. Measured distances com” 

e center in units were termed scores and were 
pared by means of the median test. 


Results r- 
Table 2 shows the differences in the P° 
mances of the two groups of subjects: sti- 
n the measure of area the group Of sare? 
onalized aged and that of normal ai 8 
ad medians of 3.0 square inches a. 
Square inches respectively. On the 5 
measure, that of distance from the conte 

inch units, the medians were 11.0 a” 


fo 
tuti 


eco” 


Human Figure Drawings 


Medians of the group with respect to the 
measure of height were 4.0 inches and 6.0 
inches respectively. 

To provide some indication of the vari- 
ability the number exceeding the combined 
median is given for both groups. For the 
measure of area the numbers are 6 and 18 
respectively. For distance from center they 
are 17 and 8, and for height they are 6 and 
19. 


Discussion and Conclusions 


The results confirm the hypothesis that 
formal characteristics of the human figure 
drawings differentiate two groups widely dif- 
fering in age and social status, and assumed 
to be widely differing in self concept and 
body image. 

The direction of the difference, the more 
constricted, shorter, and less adequately cen- 
tered productions of the institutionalized 
aged, as compared with those of the children 
is congruent with the assumed differences in 
self-attitudes among these groups. What is 
significant, in terms of the present study, is 
that the feelings of self-devaluation and a 
“shrinking” body image should find graphic 
expression in the execution of formal features 
of the drawings. On the other hand, the pos- 
sibility that certain organic factors in the 
aged result in constrictions of the figure is 
counterindicated by nonconstricted Bender- 
Gestalt drawings among this group. 

The findings seem to give additional evi- 
dence of the validity of the assumption that 
formal aspects of figure drawings are related 
to the central variables of self conceptualiza- 
tion and body image. In light of the clinical 
assumption about departures from “norma- 
tive” performance it is interesting to note 
that the children seem to perform more simi- 
larly to normal adults than do the aged sub- 
jects. Levy (1) reported an average figure 
drawing height of 7.0 inches for normal 
adults. The median figures for the aged and 
child subjects of the present study are 4.0 
inches and 6.0 inches respectively. 

The findings suggest the application of 
similar methodology in further investigation 
in this area. Comparison of drawings by in- 
stitutionalized aged and by noninstitutional- 
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Table 2 


Differences in Area Size, Height, and Distance from 
Center of Figure Drawings of Institutionalized 
Aged Persons and Normal Children 


Group 
Institu- 
tionalized Normal Median 
aged children test 
Area (sq. inches) 
Median 3.0 6.8 
Number exceeding 
combined median 6 18 10.8** 
Distance from 
center (}” units) 
Median 11.0 6.0 
Number exceeding 
combined median 17 8 7.4* 
Height (to nearest 
inch) 
Median 4.0 6.0 
Number exceeding 
combined median 6 19 ey a 


* Significant at the .01 level. 
** Significant at the .001 level. 


ized aged persons might be undertaken to 
study the question of whether changes in self 
concept and body image are due to psycho- 
logical processes attendant upon aging per se 
or whether they are related to such factors as 
relative independence of functioning and the 
effects of permanent custodial-protective care. 


Summary 


On the basis of reported observations and 
theory regarding human figure drawings and 
their relationships with self concept and body 
image it was considered that such formal 
characteristics of the drawings as area, height, 
and centeredness would reflect aspects of 
change in self concept and body image. The 
relative freedom of these variables from back- 
ground influences and from the influences of 
peripheral impairments was suggested. It was 
hypothesized that differences in self concep- 
tualization between institutionalized aged and 
preadolescent children would be reflected in 
differences in these formal aspects of the 
drawings. The drawings of 24 institutional- 
ized elderly persons were compared with those 
of 25 third-grade school children. The re- 
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IDK—I Don’t Know. When the patient says “I 
don’t know,” not in answer to a direct question, but 
as in resigrfation, disgust, or despair. Examples: 

1. “So that’s the way it happened. I don’t know 
. . - (IDK) things were all mixed up.” 

2... . and the pain has been there since then. 
(Pause) I don’t know (IDK).” 

SI—Sighing or Deep Breath. 

L—Laughing. Any kind of laugh or chuckle. 

V—Voice Change. Change in volume, becoming 
louder or lower. 

?—Questioning the Interviewer. When the patient 
asks the interviewer to repeat what he said, not for 
elaboration but because he was not heard or under- 
stood. Examples: 

1. P: “What?” (?) 

2. P: “Pardon me?” (?) 

BL—Blocking. When there js groping for the 


proper expression, indicating unusual hesitation. Ex- 
amples: 


1. “Soshe .. uh .. well... uh - + (BL) told me 
I shouldn’t come back.” 
2. "So. E soi TCR) .. (snaps fingers) (BL) I 


(R) told her I wouldn’t anyway.” 


To estimate reliability of scori 
two raters trained to: 
discussing the scorin 
ples of interviews. T 
cues on 10 intervie 


Table 1 


Percentage of Agreement of Two Raters on Each C 
ue 


ae agree 
plus 
‘ % 
Cue disagree Agreement 
UN ama ~ 
BR 5/26 15 
INT 24/72 33 
R 143/213 66 
ST 16/17 94 
IDK 9/19 47 
SI 14/14 100 
L 22/22 100 
V 41/41 100 
? 4/4 i 100 
BL 2/2 100 
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Ten-minute samples of the remaining 29 
typescripts of interviews were then cue- 
counted and a Cue Score, expressed as a per- 
centage, was computed for each interview by 
dividing the total number of times the cue 
Was scored in the interview by the total num- 
ber of typed lines of patient speech. To ana- 
lyze the interrelationships of the cues, a con? 
tingency coefficient between each distribution 
of cue scores was then computed. The 1n- 
tercorrelations indicated the groups of cues 
which we called Cue Scale I and Cue Scale II. 

Group cue scores for Cue Scale I and Cue 
Scale II were obtained by converting the cue 
Score distributions over all interviews to pers 
centile scores, then for each interview adding 
the percentile cue scores within each sole, 
Because of its negative correlation with V an 
SI, the L distribution was made negative be- 
fore combining it with them. 


Results 


Table 1 presents the raters’ agreemen : 
scoring each cue. The perfect rater aprem 
on SI, L, V, ?, and BL results from the <n 
that they are clearly marked on the PR 
script by the transcribing secretary. UN, ak 
and especially ST have respectable per e 
agreements, but it was obvious that if | 
INT, and IDK were to be used, they Trk 
have to be grouped with the more relia 
cues. 5 of 

Table 2 presents the intercorrelations re 
the cue scores. The two cues ? and BL we 


t on 


Table 2 


? Intercorrelations of Cues 
Contingency Coefficients Corrected for Class 
(39 Interviews) 


Jndex 


v 

Cue BRINT R STIDK SI L s 

13 

UN 42 20 —03 20 56 —20 —13 "43 

= 8 43 9 ms as =e 

INT — —_ 136 [56 60 D d 20 

$ == aB oe it 
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Cue-Counting: A Measure of Anxiety in Interviews 


omitted from consideration because they oc- 
curred rarely in the data and provided dis- 
tributions with very little spread. 

By inspection of Table 2, the cues were 
grouped into patterns containing the high- 
est possible intercorrelations. The following 
groupings were prominent: BR-UN-IDK- 
INT-R-ST and L-V-SI. These groups we call 
respectively Cue Scales I and II. With the 
exception of IDK, the cues of Scale I are all 
indicators of speech disruption. Scale II is 
Composed of cues related to nonverbal voice 
characteristics. The reliability of rating of the 
cues grouped in Scale I is 65 per cent and of 
those grouped in Scale II is 100 per cent. Cue 
Scales I and II have a Kendall’s rank corre- 
lation (Tau) of — .03 (p= .81). They are 
unrelated and used independently as anxiety 
measures. 


Discussion 


In the author’s study referred to earlier 
(1), the Cue Scales and three other indices 
of anxiety (skin conductance curves, clini- 
cians’ global ratings, and patients’ self-re- 
ports) were used to measure patient anxiety 
in reaction to structured or ambiguous inter- 
viewing technique. The Cue Scales showed 
significant relationships to degree of am- 
biguity, just as did the other measures. The 
anxiety measures showed no significant cor- 
relation with each other, except for the corre- 
lations (.32 and .26) of the two Cue Scales 
with anxiety ratings of transcripts by clinical 
judges. This correlation indicates only that 
both sets of speech cues (uncorrelated with 
each other) enter into a judge’s estimate of 
anxiety when reading transcripts. An analy- 
sis of the findings of the study supports the 
hypothesis that anxiety is not a unidimen- 
sional phenomenon but can be evidenced by 
activation of various physiological or .,behav- 
ioral systems in different persons. Thus a 
person who shows speech disruption in a situ- 
ation of uncertainty need not show concomit- 
ant GSR changes. Is GSR a better indicator 
of anxiety than speech disruption? At this 
point it seems safe to say only that they are 
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both methods by which we can identify anx- 
iety in order to learn more about it. The 
speech disturbances measured by the Cue 
Scales are clearly related to situational anx- 
iety and not to anxiety as a personality trait, 
for the patient groups showed significant 
speech differences in reaction to the varied 
interviewer technique although they were ran- 
domly selected and equated for diagnosis and 
several other pertinent variables. 

The Speech Scales represent speech vari- 
ables indicative of “emotionally involved” 
and disorganized verbal behavior. Some of 
the variables seem to be direct instances of 
disorganization (e.g., incomplete sentence or 
breaking in of new thoughts) and others as 
defenses against or attempts to control disor- 
ganization (e.g., repetition or modification of 
words and phrases). The lack of correlation 
(Tau = .01 and .07) of the two scales with 
the patient’s own report of anxiety leads us 
to feel that the cues of disorganization, in- 
volvement, and defense, measured by the 
scale, are anxiety indicators not subject to 
the person’s awareness. Further research 
should be done to explore other speech cues 
of anxiety, to evaluate the consistency of ap- 
pearance of the cues under varying conditions 
of anxiety, and to investigate the relationship 
of the cues to individual speech habits. The 
use of the scales as tools to measure anxiety 
related to such therapeutic phenomena as in- 
terpretation, reassurance, or transference, as 
well as for evaluation of therapeutic progress 


should be explored. 


Summary 


The derivation of two measures of transient 
or situational anxiety as revealed in speech 
has been described. The two uncorrelated 
measures are based upon a count of speech 
cues reflecting disorganization, emotional in- 
volvement, and defensiveness. The use of the 
scales in a study of anxiety in psychological 
interviews was described, and some implica- 
tions of the scales as anxiety measures were 
discussed. 


Received March 12, 1956. 
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Test Anxiety and Intelligence Test Performance 


I. Zweibelson 
Milford, Connecticut, Public Schools 


Relatively few persons have escaped the 
worry which is usually associated with the 
group tests which are used extensively in our 
culture. It is also true that there have been 
relatively few studies of the influence of fear, 
worry, and anxiety on group test perform- 
ance. Studies (3, 7) of the worries of ele- 
mentary school children have revealed that 
they worried most about test failure. It has 
also been shown (8) that college students 
with high anxiety performed noticeably more 
poorly on group intelligence tests than stu- 
dents with low anxiety. 


The Problem 


The present study * concerns the relation 
between children’s test worry or anxiety and 
their scores on group tests of mental ability 
which differed in content, format, and method 
of administration. The following question was 
posed: does performance in mental ability 
test situation x, y, or 2 differ in relation to 
the relative amount of test anxiety indicated 
by the subject? Table 1 briefly summarizes 
the important differences of the three men- 
tal ability tests used in the study: the Otis- 
Alpha, the Davis-Eells, and the Otis-Beta. 
An index of pupil test anxiety was secured 
by the investigator who read a list of 43 
questions? to 12 classes of fifth grade ele- 
mentary school children. Each child re- 
sponded on an answer sheet by circling a 


1 Adapted and condensed from a dissertation sub- 
mitted in partial fulfillment of the requirements for 
the Ed.D. degree at Teachers College, Columbia 
University, in 1955. Part of the data were collected 
in connection with the USPHS Project M-712 un- 
der the direction of Professor Seymour B. Sarason 
of Yale University. 

2 The questionnaire used was developed under the 
direction of Professor Sarason of Yale. 


“Yes” or “No” for each question. The ques- 
tions dealt specifically with fears, worries, 
and feelings in test and testlike situations. 


Hypotheses 


1. Given three tests of mental ability, the 
Davis-Eells, the Otis-Alpha, and the Otis- 
Beta, performance on the Davis-Eells and the 
Otis-Alpha tests should be less related to test 
anxiety than in the case of the Otis-Beta. 

2. In the case of the Otis-Beta and the 
Davis-Eells, the ‘“High-Anxious” should do 
better on the mental ability test taken second 
than on the one taken first, regardless of the 
test, i.e., the order in which the tests are 
taken will have an effect on the scores of the 
“High Anxious.” 


Design 


Five of nine elementary schools in Mil- 
ford, Connecticut, were selected as schools 
which served town areas thought to be repre- 
sentative of pupils in all of the town schools. 
All of the fourth grade children in the se- 
lected schools were given three mental abil- 
ity tests (1, 5, 6) and the Test Anxiety 
Questionnaire. The Otis-Alpha and the Ques- 
tionnaire were administered in the ninth 
month of the fourth grade school year. The 
Otis-Beta and the Davis-Eells were adminis- 
tered during the first month of the fifth grade 
school year. Half of the pupils were given 
the Otis-Beta first and half the Davis-Eells 
first—the total M was 258. There was ap- 
proximately a week between the administra- 
tion of the first and the second tests. 


Results 


The correlations among the three mental 
ability tests were: 
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Table 1 
E Major Differences of Three Group Mental Ability Tests 
Diference 
i is-Beta 
Otis-Alpha Davis-Eells Otis 
Factor a 
variety of problems in- real-life problems, perso- school achieve 
‘Hest items clude geometric, pictorial, nal oriented 
and language ability items 
Styl semiacademic semihumorous academic 
tyle 
here 
iformal test atmos- game atmosphere stressed formal test atmosp 
Method of semifo 
Administration phere . 
; vision for pre 
i isi ise i visi tle provision 
i little provision for praise substantial provision for lit a 
a and reassurance praise and reassurance and reassuran 
Format free of reading 


small, clear pictures 


picture or symbol marked 


booklet form 


Provision for 


short period Preceding 
Practice 


each of two sittings 
Time Limit 40-50 minutes 
Speed Factor emphasis tends to be on 
Power although some 
don’t have time to try all 
of the items 


free of reading 
large, clear pictures 


large space for mark next 
to test item 


booklet form 


substantial periods pre- 
ceding several sections 


100-120 minutes 


emphasis upon power, 
each pupil could attempt 
every item 


reading required 
print 


rate 
small space on sepa 
sheet for mark 


7 i 
3 sheets fold like acco 
dian 


ing the 
short period preceding 
one sitting 


30 minutes 


nt, no pupil 


speed importa y item 


could attempt ever, 


Otis-Alpha vs. Davis-Eells 


59 
Otis-Alpha vs, Otis-Beta 55 
Davis-Eells vs. Otis-Beta 49 


These correlations are significant at the one 
per cent level of probability, 


The correlations among the test: 


S and test- 
anxiety scores were: 
Otis-Alpha vs. Text Anxiety — 28 
Otis-Beta vs. Test Anxiety = 24 
Davis-Eells vs. Test Anxiety — 14 


These correlations are significant at the five 
per cent level. The significance of the differ- 
ences between the Test Anxiety and the in- 
telligence test correlations was found by the 
use of a formula developed by Hotelling and 
given by Walker and Lev (9, p. 257). In 


. i ne í 
this formula the correlations among ie 
are taken into account. The differ 


ae 


ests 
þe- 


o 
, +. Beta 7 
tween the Test Anxiety vs. Otis-Be 


is-Ee 
= 24 and the Test Anxiety vs. Dan Sagn 
r of — .14 was not found to be oe i 
although the results are in the predic 
rection (p = 10). The difference betw 
Test Anxiety vs, Otis-Alpha r of — a 
the Test Anxiety vs. Davis-Eells 7 “ave 
was found to be significant at the that 
cent level of probability. It appears 

tst hypothesis receives support from 


fi 


Eells 
7 
di- 
een the 
28 a 


per 
the 
these 


: s 
results although it is most clear in term 
the Otis-Alpha vs. Davis-Eells data- nsiov® 
Table 2 shows that the “low” ng G 
make higher mental ability indices t of 


“high” 


rde” 
test-anxious regardless of the 0 test 


he 
test administration and regardless oft 


Test Anxiety and Intelligence Test Performance 


instrument. There is also a tendency for the 

High Anxious” to do better on the test taken 
second than on the test taken first. However, 
an analysis of variance of the data reported 
in Table 2 shows no significant variation in 
the size of the difference between the Davis- 
Eells and Otis-Beta indices because of: (a) 
the effect of the extent of test anxiety; or 
(b) the effect of the order in which tests 
Were taken; or (c) the effect of the interac- 
tion of these variables. It should be pointed 
out, however, that the order of test admini- 
tration was the greatest source of variation 
of the several sources investigated. The data 
in Table 2 clearly do not allow one to accept 
Hypothesis 2, although the fact that the 
trends are in the predicted direction suggests 
that consideration of other factors in future 
studies may give more positive results. It 
might be pointed out in this connection that 
in studies of test anxiety with college students 
(2, 4) and children there is evidence that the 
“High Anxious” subjects tend to improve 
rather markedly in the course of learning. 


Discussion 


The results of the present study support 
the position that test anxiety may be related 
to and effect group test results. There is also 
some support for the Davis and Eells con- 
tention that their test is less influenced by 
anxiety than other conventional tests. Evalua- 
tion-connected experiences which involve fail- 
ure or threat of failure may serve to engender 
personal reactions which interfere with test 
performance. The standardized group test 
Situation may have threatening factors inad- 
vertently attached to the experience by the 
test-maker or the examiner. . 

The anxiety-provoking role of the examiner 
has not been studied in this present investi- 
gation. The different examiners (teachers and 
psychologists) in this study may have influ- 
enced the results by provoking different anx- 
ious reactions in the children. It seems im- 
portant to draw attention to such possibili- 
ties and to suggest that the examiner’s role 
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Table 2 


Mean and Variance of Mental Ability Test Scores of 
High and Low Test-Anxious Pupils Within 
Order of Test Administration 
(N = 33 in each group) 


Pupil test anxiety 


Lower 31% Upper 31% 
Order of administration X s? X s? 
Otis-Beta Administered i 
First 
Otis-Beta Score 5.5 3.9 4.0 2.2 
Davis-Eells Score 54 3.8 4.4 24 
Davis-Eells Administered 
First 
Otis-Beta Score 5.0 3.1 3.9 4.2 
Davis-Eells Score 4.7 31 34 3.5 


in effecting group test performance might 
warrant investigation. 
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The Relation of the Children’s Manifest Anxiety 
Scale to the Concept of Anxiety as Used 
in the Clinic’ 


Robert D. Wirt and William E. Broen, Jr. 


University of Minnesota 


Considerable research has been published in 
recent years indicating relationships between 
a construct measured by the Taylor Manifest 
Anxiety Scale (MAS) and other variables 
mainly within the scope of learning theory. 
Taylor recently has reviewed this work (2). 
More recently Castaneda, McCandless, and 
Palmero have adapted the MAS for use with 
children (CMAS) and have reported research 
indicating that its relationship to other vari- 
ables approximates that of the adult form of 
the scale (1). 


Because of the importance of the anxiety 


investigated 
AS and the 
clinic. Using 
n in the 4th, 
neapolis Pub- 


een anxiety as 
diagnostic study 

1An extended report of th 
tained without charge from Robert D. Wirt De- 
partment of Psychology, University of Minne: 
Minneapolis 14, Minnesota, or for a fee from 
American Documentation Institute. 
from the latter source, order Docu: 
from ADI Auxiliary Publications 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.25 for micro- 
film or $1.25 for photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. i 

2 Now at the University of Kansas, 


is study may be ob- 


sota, 
the 
To obtain it 
ment No. 5038 
Project, Photo- 


or as rated by teachers and scores on m 
CMAS (not verified); that intelligence Wot 
be inversely related to CMAS scores in- 
verified); and that there would be = 
verse relationship between CMAS and T ar- 
ing achievement scores with “oe : 
tialled out (significant at the .04 leve X 
As a result of this research we feel pee 
CMAS (and the MAS insofar as it valuable 
Parable) although undoubtedly a va ome- 
and predictive instrument is measuring Tini- 
thing different than is denoted by P ntradic- 
cal concept of anxiety. We find no we cite 
tion between this conclusion and “lationship 
by Taylor (2) which shows a en use 
between the MAS and other clinical at un- 
variables. We believe the common a “yill 
derlying the relationships to be one on self” 
ingness to say deviant things about js 00 
or “test-taking attitude” which factor as the 
necessarily highly related to anxiety ing 58 
concept is clinically used. Studies sona mani- 
nificant relationships have peepee f 
fest anxiety, as, of course, do the n 
the scales. cep 
As has been pointed out by others, ae de- 
such as anxiety need much more ca" en. We 
Notation than they have yet been a op 
are presently engaged in further res¢ of oi” 
the construct of anxiety with the hope 
ing it greater specificity. 
Brief Report. 
Received July 30, 1956. 
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The “Alienation Syndrome” and Adler's Concept 
of “Distance” 


H. L. Ansbacher 


University o, 


In a paper published in this Journal and 
entitled “Alienation, social apperception, and 
ego structure,” Anthony Davids (2) reported 
an Affect Questionnaire which he constructed 
in collaboration with Henry A. Murray. The 
questionnaire measures eight critical dispo- 
sitions of personality: sociocentricity, opti- 
mism, and trust (three “positive” or socially 
desirable dispositions); and egocentricity, 
pessimism, distrust, anxiety, and resentment 
(fve “negative” or socially undesirable dis- 
positions). Statistical analysis of results ob- 
tained with this questionnaire from Harvard 
students led to the formulation of a syndrome 
termed “alienation,” which is composed of 
the five negative dispositions. 

The purpose of the present note is to show 
that the concept of “alienation” bears close 
resemblance to Adler’s concept of “distance.” 
Etymologically, the two terms have in com- 
mon the idea of isolation from the group 
(like the sociologists’ term “anomie”), the 
first denoting the feeling of being a stranger, 
the second, the attitude of standing apart 
from the rest. 

Adler’s “distance” manifests itself 
fourfold modus of, figuratively, moving back- 
ward, standing still, hesitating, or construct- 
ing obstacles (1, pp. 273-276). All kinds of 
anxiety are seen as forms of distance behav- 
ior. To anxiety so described, Adler subordi- 
nates a number of specific feelings and atti- 
tudes which bear close similarity to Davids’ 
negative dispositions. In order to demonstrate 
this, we shall insert in the following quota- 
tion from Adler the corresponding descrip- 
tive terms from Davids. 


in a 
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f Vermont 


Once a person has acquired the attitude of run- 
ning away from the difficulties of life, this attitude 
may be greatly strengthened and safeguarded by the 
addition of anxiety (Davids’ anxiety)... . It em- 
bitters (Davids’ resentment) his life to a marked de- 
gree, renders him quite unsuited for making con- 
tacts, and thus also for laying the basis for a peace- 
ful life and for fruitful accomplishments. ... We 
shall meet again the well-known type who feels him- 
self forced by necessity to think more of himself 
and consequently has little left for his fellow man 
(Davids’ egocentricity). As though in confirmation 
of this view one often finds that such people are in- 
clined to think of the past or of death, which has 
about the same effect... . Or they emphasize that 
all is vanity, after all, that life is short, and one can- 
not know what will happen (Davids’ pessimism)” 
(1, pp. 276-277). 


This quotation permitted the insertion of 
all of Davids’ negative dispositions except 
distrust, which is found in Adler under the 
heading of Oversensitivity, one of the char- 
acteristics of the neurotically disposed indi- 
vidual. “Distrust in his own strength which 
awakens doubt about everything; distrust in 
others which is socially disturbing and dis- 
rupts every group—these at times character- 
ize the oversensitive patient” (1, p. 290). 

With these similarities, it is understandable 
that the further findings of Davids are in ac- 
cordance with Adlerian theory. This is true 
especially for the finding “that individuals 
who view the world and their relationship to 
it in a negative (i.e., alienating) light have a 
weak ego structure (i.e., poor personal and 
social adjustment) as estimated by experi- 
enced clinical judgment” (2, p. 27). Adler 
had started with the observation that poor 
adjustment is characterized by the syndrome 
of distance which is the resultant of increased 
inferiority feelings and lack of social interest. 


2 


9 
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Davids developed the Affect Questionnaire 
to investigate relations between degree of 
alienation, social apperception, and ego struc- 
ture, meaning ego strength vs. ego weakness. 
Not only by the formulation of the concept 
of alienation, but also by this purpose, is 
Davids’ investigation in line with Adlerian 
theory. The relationship, according to Adler, 
would be: The maladjusted (alienated) indi- 
vidual is one who, due to increased inferior- 
ity feelings (ego weakness) and concomitant 
lack of social interest, apperceives the world 
as a hostile place. “Schema of apperception” 
is a term frequently employed by Adler. Spe- 
cifically, the content of the schema of apper- 
ception of the maladjusted would be: They 
“feel and live as though they were in an 
enemy country. Fighting, hesitating, stopping, 


H. L. Ansbacher 


escaping, much more occupied with their own 
persons than with others, they are therefore 
selfish, inconsiderate, lacking in social inter- 
est, courage, and self-confidence because they 
fear defeat more than they desire success 
(1, p. 118). l 5 
Altogether, the paper by Davids can wè 
be taken as experimental support and exten- 
sion of Adlerian theory. 
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Some Comments on Ansbacher’s Note on 
the “Alienation Syndrome” and Adler's 
Concept of “Distance” 


Anthony Davids 


Brown University and Bradley Home 


It is indeed gratifying when another in- 
vestigator is able to make use of one’s find- 
ings in building a bridge between empirical 
data and theory. This is especially true when 
the data were not gathered with a view to- 
ward supporting or refuting hypotheses de- 
rived from the particular theory with which 
they are eventually linked. The fact that the 
theory in question, that of Adlerian psychol- 
ogy, is not particularly new on the psycho- 
logical scene, coupled with the fact that this 
theory has been submitted to very little ex- 
perimental verification in controlled experi- 
ments, makes it seem all the more noteworthy 
that Ansbacher (2) was able to use our re- 
cent experimental evidence to support Adler’s 
theoretical statements. 

First, let me make a few comments on the 
dispositions which form the personality syn- 
drome of alienation. On numerous occasions 
I have been asked why we chose to work with 
these particular eight dispositions of person- 
ality. That is, why did we include just these 
eight dispositions in our researches? Murray 
and I were first faced with the problem of 
choice of attributes to study when we em- 
barked upon the task of constructing an au- 
ditory projective technique (5) several years 
ago. We wanted to include in this auditory 
test spoken statements and phrases indicative 
of certain critical dispositions of personality. 
By means of selective perception, apper- 
ception, accentuation, and retention of the 
spoken statements we hoped to secure a 
measure of the extent to which the perceiver 
possessed the various dispositions in his own 


personality. In our original pilot studies we 
experimented with many variables in addi- 
tion to those which have now come to be re- 
garded as forming an “alienation syndrome.” 
For example, we employed other dispositions 
or attributes, such as self-pity, gratitude, ac- 
tivity, passivity, and several others. 

On the basis of these pilot studies, we 
found that it was difficult to differentiate 
sharply among certain of the dispositions. 
That is, we found that both in writing state- 
ments to represent certain dispositions and 
in attempting to score subjects’ responses, 
certain dispositions tended to overlap and 
some seemed not to be assessed with as much 
validity as others. Consequently, on the basis 
of practical considerations and preliminary 
studies, we decided to focus on the eight dis- 
positions which are currently measured by 
both the auditory projective technique (5) 
and the Affect Questionnaire (4). 

It should be pointed out, however, that de- 
ciding upon these dispositions was not merely 
an empirical or a theoretical development. 
These dispositions were proposed by Murray 
as being of critical importance based on his 
theory of personality dynamics and on his 
years of intensive investigation of normal and 
abnormal personalities. If one looks into Mur- 
ray’s contributions to the field of personality 
assessment (e.g., 7, 8, 9) it is evident that 
these eight dispositions, and several others, 
have long played a prominent role in his 
theorizing and his empirical investigations. 
Thus, the selection of these eight dispositions 
for study was based upon Murray’s wisdom, 
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experience, and clinical knowledge about traits 
or dispositions that are of critical importance 
in the dynamics of personality. 

Turning now to consideration of the Affect 
Questionnaire, it was constructed originally 
as an instrument against which to validate 
findings derived from the auditory projective 
test. This technique attempts to assess the 
relative strength of the eight dispositions in 
subjects’ personalities by having them indi- 
cate their degree of agreement or disagree- 
ment with statements designed to represent 
the various dispositions. It was found that 
two experienced clinical psychologists could 
agree perfectly in their classification of the 
Statements as indicative of the different dis- 
Positions. When the Affect Questionnaire 
(which consists of 10 statements representa- 
tive of each of the eight dispositions, mak- 
ing a total of 80 items) was administered 
to groups of subjects, it was found that 
there were highly signi 
among the five negative dispositions, and that 
scores on these dispo. 
correlated with score 
positive dispositions. 
these empirical findin 


negative dispositions 
tion syndrome.” 
F rom the brief description of the selection 
of dispositions for study and the empirical 
findings which led to formulation of the syn- 
drome, it is quite evident that the link with 
or similarity to, Adler’s Concept of “distance” 
was not readily apparent to Us, Nor were our 
researches motivated by Adlerian theory. 
Thus, it seems quite striking that our em. 
pirical findings fit so heatly with Adler’s 
theoretical formulations, and that these dis- 
positions do, in fact, tend to Coexist in the 
personality just as Adler believed on the ba- 
sis of his theoretical convictions and his clini- 
cal experience. 

Today much research attention 
voted to submitting to experiment 
of the theoretical notions put for 
on the basis of his clinical expe 
ever, this does not seem to be 
Adlerian theory. It is, therefo 


is being de- 
al test many 
th by Freud 
rience. How- 
the case with 
Te, especially 


Anthony Davids 


interesting to find that an experiment such 
as ours, which fits into the currently popular 
area of research termed “social perception 
and which uses experimental techniques and 
statistical procedures, fits so nicely with hy- 
potheses that would be generated by Adlerian 
theory. In other words, if we had taken as 
our point of departure the theoretical _— 
and statements advanced by Adler, and bet 
designed our researches specifically to tes 
Propositions derived from his theory, We 
would have confirmed them in a well-con- 
trolled laboratory investigation employing 
modern statistical procedures. Since there is; 
undoubtedly, much of value in Adler’s theory 
(3), and since many features or derivatives 
of Adlerian theory are put to use in shea? 
day clinical practice (1, 6, 10), it seems o 
real value that Ansbacher was able to per 
ceive the link between our seemingly unre- 


lated experiment and Adler’s theoretical con- 
cepts. 
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J 
Blum, Gerald S. The Blacky Pictures. New York: 
Psychological Corp., 1950. 


Reviewed by 


Samuel J. Beck 
University of Chicago 


A homely, obstreperous, and by now not unloved 
canine, who plays the title—and perhaps a hero’s— 
role, this is Blacky of the Blacky test. Sired by psy- 
choanalysis out of TAT he was created ad hoc: to 
test out psychoanalytic theory concerning psycho- 
sexual development, Videlicet, the title of Blum’s 
monograph (2). It is a bold ingress into that most 
fluid area of psychology—depth psychology—which 
Blum undertakes, one more specific in purpose and 
design than those which projective tests have so far 
essayed. These, pioneers that they are, opening up a 
totally new field, have been engaged in attempting 
some broad estimate of the new territory, apprais- 
ing its potential yield in terms of fresh knowledge 


concerning the human personality or, at the least, 

fresh ways of studying it. They have been treading 

. warily, with some trembling at the shapes and sights 

at unholy lurking in the scientific jungle that surrounds 

A the regions of the human personality. However, as at 

| other frontiers, the pioneers are followed by the more 

intensive cultivators. These latter can stake out, each 

| «his special acre, and so a method like that of the 
projective tests advances, by new experiment. 

Blum has devised a test ad hoc for psychoanalytic 

Wi theory by the ingenious technique which activates 

. certain of the psychoanalytically formulated uncon- 

scious traits, at the same time that it provides the 

defenses enabling the patient to liberate and com- 

\ municate these forbidden trends—the defenses of 

| \ identification and displacing. I am not using any of 

j the space allotted to me for this review in describ- 

| ing the test. He who has not yet made the acquaint- 

ance of the very human Blacky is referred to his 

creator’s monograph (2). In carrying on his experi- 

ment, Blum used, as his point of departure, thirteen 

“dimensions” in psychoanalytic theory. Anyone even 

superficially read in this field will recognize the 

terms. His results, in University of California stu- 

p” dents, showed statistically significant differences be- 

4 tween the sexes, statistically significant relationships 

a between dimensions, and evidence in the writings of 

a 
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Freud and of Fernichel (he quotes the text from 
both) showing an impressive consistency between 
Blum’s significant findings and psychoanalytic the- 
ory. He arrives at the cautious conclusion that “some 
aspects of psychoanalytic theory have demonstrable 
validity.” 

In the few years since he published, his test and 
findings have been subjected to fairly extensive re- 
Search, not surprising what with the dominance of 
both psychoanalysis and projective instruments on 
the current Psychological scene. Within a year, Sew- 
ard criticized the exclusion of statistically insignifi- 
cant but relevant data in Blum’s report, and also 
pointed to some likely logical flaws (11). Michal- 
Smith, Hammer, and Spitz found their Blacky test 
analysis consistent with indication of Oedipal inten- 
sity in a nine-year-old boy (8). Paranoids were 
studied by Aronson (1) and he reported partial con- 
firmation of Blum’s results. Other investigations that 
have come to my attention (I am making no pre- 
tense here to an exhaustive survey of the literature) 
are: Blum and Kaufman (4) in 14 male patients 
with peptic ulcer; McNeil and Blum (7) relating 
handwriting signs with the psychosexual dimensions; 
and Ellis (6), who, in a patient with some two hun- 
dred hours of psychoanalysis, had the test rated by 
22 other psychologists. In a survey published in 1952 
by Blum and Hunt (3), they reported also an in- 
vestigation in stutterers (Merchant); sexual offend- 
ers (Lindner); behavior in small groups (Swanson). 
A more recent investigation is that of Molish, Lyon, 
and Briggs (9), who compared Blacky test findings 
in 1947 naval recruits found “not maladjusted” by 
the Navy’s neuropsychiatry service, with 390 re- 
cruits who were rejected as unsuitable. These in- 
vestigators, while alert to the psychoanalytic impli- 
cations of their results, were especially interested in 
the test’s potency for differentiating their two groups. 
An inference from their research is that, whatever 
the agreements with psychoanalytic theory, the 
Blacky has its value in practical application, as de- 
rived from empirical data. 

The test has thus a differentiating potency, and 
without a doubt it has the projective instrument 
value of opening a window to latent character traits. 
At the same time results are suspect, as I see it, by 
reason of a major fallacy in the technique of treat- 
ing the data. This consists in the method of “scor- 
ing” each story and the other criteria as “strong” 
and the various gradations of “strong.” The judg- 
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ments are made by each examiner, without recourse 
to any frame of reference, Scorings must, there- 
fore, be a function 
concede, be made reliable as between two i 


signs and language, i 
and naming the Psychological traits or 
Except between two such 


scored “strong” (2, p. 34). 
Pression—which isa hypothesis and not a datum— 


sults. Schafer (10) has been 
cerning the interpersonal rel; 


(S, p. 131). 2 
An important implicati 
sitions of Schafer an f 
investigations wi 
keeping the examiner fact T con, 
nen — Persons are to 
Problem becomes at this poj 
tists and logicians of seiste, P his a votes, theo- 
not, however, ease the burden t e pesanta does 
searching personality by 


fo ows from these po- 
en * Projective test 

method of 
ant, if reports by 
© comparable, The 


Means o; 


Psychological Test Review 


agreement with 
sound. It can serve, fur- 
ther, as an example of other ad hoc techniques which 
can be devised to explore Psychoanalytic theory, 
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